00000001:02000400:3.0F:1787786163.224418:0:2968:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg434-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1787786181.841597:0:3188:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg434-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1787786183.950040:0:3232:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 519 MB/s 00000001:01000000:2.0F:1787786184.199862:0:3232:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 579 MB/s 00000001:01000000:3.0:1787786184.449897:0:3232:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3059 MB/s 00000020:02000000:3.0:1787786185.194565:0:3280:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_53_g458ba6d 00000400:02000000:1.0F:1787786185.786366:0:3295:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.204.134@tcp [8/256/0/180] 00008000:02000000:2.0:1787786189.790120:0:3445:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1787786246.593012:0:5249:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg434-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787786256.709854:0:5827:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787786256.709862:0:5827:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787786256.710865:0:5827:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000eb6be805 00000080:02000400:2.0:1787786256.710883:0:5827:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1787786256.717510:0:5827:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1787786256.717527:0:5827:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787786256.717578:0:5827:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000087af8236) 00000020:00000080:2.0:1787786256.717602:0:5827:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787786256.757764:0:5827:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787786256.758646:0:5827:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787786256.789271:0:5827:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787786256.789315:0:5827:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787786256.789336:0:5827:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787786256.789389:0:5827:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787786256.789414:0:5827:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787786256.789836:0:5827:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787786256.789845:0:5827:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787786256.789856:0:5827:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x450132973bff1dac 00000020:01000004:3.0:1787786256.789865:0:5827:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787786256.789884:0:5827:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787786256.789889:0:5827:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000eb6be805 from MGS 00000020:01000004:3.0:1787786256.789894:0:5827:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787786256.789914:0:5827:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000009ea13f77) 00000020:00000080:3.0:1787786256.789928:0:5827:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787786256.789991:0:5827:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000eb6be805 from MGS, refs=2 00080000:01000000:3.0:1787786256.790365:0:5827:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787786256.790376:0:5827:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x450132973bff1dba 00000100:00100000:3.0:1787786256.790526:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787786256.790671:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787786256.790679:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787786256.791679:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787786256.791691:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787786256.796207:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787786256.796714:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787786256.796721:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787786256.799197:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787786256.799212:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1787786256.799826:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1787786256.799835:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787786256.801453:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786256.801461:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786256.801464:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786256.801837:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786256.801840:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786256.801841:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786256.802592:0:5827:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787786256.804554:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1787786257.052152:0:5827:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3563 MB/s 00000001:01000000:2.0:1787786257.304889:0:5827:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3810 MB/s 00000001:01000000:2.0:1787786257.557287:0:5827:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 555 MB/s 00000001:01000000:3.0:1787786257.809984:0:5827:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 908 MB/s 00080000:10000000:3.0:1787786257.820498:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1787786257.844502:0:5827:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787786257.844522:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787786257.844530:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787786257.852459:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787786257.852579:0:5827:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787786257.855024:0:5827:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1787786257.855342:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1787786257.855376:0:5827:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787786257.855780:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787786257.857075:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787786257.857084:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787786257.858561:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787786257.858587:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1787786257.859196:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1787786257.859204:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787786257.863631:0:5827:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787786257.863787:0:5827:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.134@tcp' 00000020:01000004:2.0:1787786257.863807:0:5827:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000100:00080000:0.0:1787786257.863922:0:5842:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:01000004:2.0:1787786257.863984:0:5827:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.134@tcp (typ=mgc) 00000020:00000080:2.0:1787786257.863999:0:5827:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.134@tcp (0000000071ec4217) 00000020:00000080:2.0:1787786257.864022:0:5827:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787786257.864275:0:5827:0:(ldlm_lib.c:102:import_set_conn()) imp 000000007d5bf941@MGC192.168.204.134@tcp: add connection 192.168.204.134@tcp at head 00010000:00010000:2.0:1787786257.864445:0:5827:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.134@tcp-0 is initialized 00000040:01000000:2.0:1787786257.864452:0:5827:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.134@tcp ctxt 1 is initialized 10000000:01000000:2.0:1787786257.865650:0:5843:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1787786257.865694:0:5827:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.134@tcp (uuid a44a06f2-32e6-4870-9ef4-9f12b11e8ae1) 00000020:00000080:2.0:1787786257.865715:0:5827:0:(genops.c:1385:class_connect()) connect: client a44a06f2-32e6-4870-9ef4-9f12b11e8ae1, cookie 0x450132973bff1dc8 00000100:00080000:2.0:1787786257.865728:0:5827:0:(import.c:510:import_select_connection()) MGC192.168.204.134@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787786257.865733:0:5827:0:(import.c:624:import_select_connection()) MGC192.168.204.134@tcp: import 000000007d5bf941 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:2.0:1787786257.865770:0:5827:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000061bd2be7 x1874629686722688/t0(0) o250->MGC192.168.204.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787786257.866136:0:5827:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a44a06f2-32e6-4870-9ef4-9f12b11e8ae1->MGS 00000020:01000004:2.0:1787786257.866153:0:5827:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787786257.866158:0:5827:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787786257.866169:0:5827:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000051d6036a) 00000020:00000080:2.0:1787786257.866192:0:5827:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00010000:00010000:3.0:1787786257.871020:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786257.871695:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061bd2be7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3310:1874629686722688:0@lo:250: 00000100:00100000:3.0:1787786257.873936:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786257.874155:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686722688 00000100:00100000:3.0:1787786257.874166:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686722688 00000100:00100000:3.0:1787786257.875332:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787786257.875340:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067b90f6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3310:x1874629686722688:12345-0@lo:250: 00010000:00080000:3.0:1787786257.875369:0:5839:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a44a06f2-32e6-4870-9ef4-9f12b11e8ae1@0@lo t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:3.0:1787786257.875397:0:5839:0:(genops.c:1385:class_connect()) connect: client a44a06f2-32e6-4870-9ef4-9f12b11e8ae1, cookie 0x450132973bff1dd6 00000100:00080000:3.0:1787786257.877480:0:5839:0:(import.c:65:import_set_state_nolock()) 000000007dc99b82 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787786257.877587:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067b90f6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+5:3310:x1874629686722688:12345-0@lo:250: Request processed in 2243us (3660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786257.877598:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787786257.877695:0:3310:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.134@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787786257.877707:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.134@tcp: connect to target with instance 0 00000100:00080000:3.0:1787786257.877716:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.134@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787786257.877721:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787786257.877724:0:3310:0:(import.c:65:import_set_state_nolock()) 000000007d5bf941 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787786257.877727:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787786257.877735:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787786257.877741:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061bd2be7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3310:1874629686722688:0@lo:250: 00000100:00100000:0.0:1787786257.910735:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787786257.911113:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1787786257.911120:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787786257.912311:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787786257.912327:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787786257.912733:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787786257.912740:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787786257.917409:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787786257.917682:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787786257.917689:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787786257.918279:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787786257.918286:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787786257.985587:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787786257.985960:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787786257.985969:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1787786257.987499:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1787786257.987516:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787786257.989293:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787786257.989713:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787786257.989723:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787786257.992547:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787786257.992562:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787786257.993285:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787786257.993508:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787786257.993515:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787786257.995661:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787786257.995677:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787786257.996727:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787786257.997084:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787786257.997090:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787786257.998390:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787786257.998400:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787786258.029615:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787786258.029967:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787786258.029974:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1787786258.032624:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787786258.032644:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787786258.034542:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787786258.034562:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787786258.035708:0:5827:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787786258.035731:0:5827:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1787786258.035738:0:5827:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.134@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787786258.036324:0:5827:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.134@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787786258.036365:0:5827:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.134@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1787786258.036370:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787786258.036372:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787786258.036373:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787786258.036375:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787786258.036376:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787786258.036377:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787786258.036378:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787786258.036380:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787786258.036381:0:5827:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787786258.036383:0:5827:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787786258.036384:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787786258.036386:0:5827:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787786258.036389:0:5827:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1787786258.036391:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787786258.036393:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787786258.036394:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787786258.036395:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787786258.036396:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787786258.036397:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787786258.036398:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787786258.036398:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787786258.036399:0:5827:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787786258.036400:0:5827:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787786258.036400:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787786258.036401:0:5827:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787786258.036437:0:5827:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787786258.042501:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ae282713 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5827:1874629686722816:0@lo:253: 00000100:00100000:1.0:1787786258.042681:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786258.042762:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a092e2c8 going to sleep for 11 seconds 00000100:00100000:2.0:1787786258.042788:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686722816 00000100:00100000:2.0:1787786258.042839:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686722816 00000100:00100000:2.0:1787786258.042907:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787786258.042918:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096e2ddc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+5:5827:x1874629686722816:12345-0@lo:253: 20000000:01000000:2.0:1787786258.042978:0:5841:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787786258.042981:0:5841:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1787786258.044990:0:5862:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787786258.045069:0:5841:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1787786258.045551:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787786258.047755:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1787786258.047967:0:5841:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787786258.047972:0:5841:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1787786258.047978:0:5841:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1787786258.047982:0:5841:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1787786258.047995:0:5841:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1787786258.048395:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787786258.048636:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1787786258.048651:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787786258.048702:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1787786258.048751:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1787786258.048787:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1787786258.048932:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1787786258.048941:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1787786258.048989:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1787786258.048997:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1787786258.049027:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1787786258.049034:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1787786258.049061:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1787786258.049109:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1787786258.049146:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1787786258.049150:0:5841:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1787786258.049162:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787786258.049370:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1787786258.049380:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787786258.049411:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1787786258.049444:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1787786258.049514:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1787786258.049524:0:5841:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1787786258.049586:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1787786258.049593:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787786258.049634:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1787786258.049680:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1787786258.049714:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1787786258.049725:0:5841:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1787786258.049856:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1787786258.049865:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1787786258.049902:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1787786258.049934:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1787786258.050087:0:5841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1787786258.050132:0:5841:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1787786258.050141:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1787786258.052299:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1787786258.053312:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1787786258.053352:0:5841:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.134@tcp for mdt 20000000:01000000:1.0:1787786258.053355:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.134@tcp (null) (null) (null) 00000040:00080000:1.0:1787786258.053395:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1787786258.053403:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1787786258.053435:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1787786258.053443:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.134@tcp (null) (null) 00000040:00080000:1.0:1787786258.053501:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1787786258.053511:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1787786258.053546:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1787786258.053580:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1787786258.055170:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787786258.055724:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1787786258.055730:0:5841:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1787786258.055737:0:5841:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1787786258.061275:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:0.0:1787786258.061633:0:5841:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1787786258.073907:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1787786258.074087:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:0.0:1787786258.074175:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:0.0:1787786258.074197:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1787786258.074201:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1787786258.074205:0:5841:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1787786258.074227:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787786258.074230:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1787786258.074260:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787786258.074263:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787786258.075739:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1787786258.076103:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1787786258.076150:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1787786258.076228:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:0.0:1787786258.076243:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787786258.076246:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787786258.077376:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1787786258.079703:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1787786258.079761:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1787786258.080079:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1787786258.080112:0:5841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787786258.080114:0:5841:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:2.0:1787786258.080122:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787786258.080141:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f4838edd/0x450132973bff1ddd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.080159:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f4838edd/0x450132973bff1ddd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.080169:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f4838edd/0x450132973bff1ddd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.080174:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f4838edd/0x450132973bff1ddd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.080179:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f4838edd/0x450132973bff1ddd lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.080197:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f4838edd/0x450132973bff1ddd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.080203:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f4838edd already unused, calling callback (0000000068ef859f) 00010000:00010000:2.0:1787786258.080206:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f4838edd/0x450132973bff1ddd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.080212:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f4838edd/0x450132973bff1ddd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.080223:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f4838edd/0x450132973bff1ddd lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.080229:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f4838edd/0x450132973bff1ddd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.080234:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f4838edd/0x450132973bff1ddd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787786258.080249:0:5841:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787786258.294750:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096e2ddc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+5:5827:x1874629686722816:12345-0@lo:253: Request processed in 251828us (252063us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786258.294765:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787786258.295096:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ae282713 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5827:1874629686722816:0@lo:253: 10000000:01000000:2.0:1787786258.295120:0:5827:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787786258.295124:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787786258.295126:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787786258.295127:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787786258.295129:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1787786258.295131:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787786258.295132:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787786258.295133:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787786258.295135:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787786258.295136:0:5827:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787786258.295157:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787786258.295159:0:5827:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787786258.295180:0:5827:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000eb6be805 from lustre-MDT0000 10000000:01000000:2.0:1787786258.295208:0:5827:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1787786258.295210:0:5827:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787786258.295215:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8b52090acd28 10000000:01000000:2.0:1787786258.295219:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787786258.295227:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8b52090acd28 from 1 10000000:01000000:2.0:1787786258.295230:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787786258.295269:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: 00000000f4838edd/0x450132973bff1de4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.295279:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: 00000000f4838edd/0x450132973bff1de4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.295287:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: 00000000f4838edd/0x450132973bff1de4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786258.295305:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061bd2be7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5827:1874629686722944:0@lo:101: 00000100:00100000:2.0:1787786258.295365:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786258.295486:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 0000000023ad3051 going to sleep for 11 seconds 00000100:00100000:3.0:1787786258.295559:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686722944 00000100:00100000:3.0:1787786258.295568:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686722944 00000100:00100000:3.0:1787786258.295612:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787786258.295623:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040f7e5be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+5:5827:x1874629686722944:12345-0@lo:101: 00010000:00010000:3.0:1787786258.295641:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786258.295661:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ccd2c54d/0x450132973bff1deb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff1de4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786258.295689:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ccd2c54d/0x450132973bff1deb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff1de4 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786258.295701:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ccd2c54d/0x450132973bff1deb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1de4 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786258.295712:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ccd2c54d, rc 0) 00000100:00100000:3.0:1787786258.295758:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040f7e5be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+6:5827:x1874629686722944:12345-0@lo:101: Request processed in 138us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786258.295764:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787786258.295874:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061bd2be7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5827:1874629686722944:0@lo:101: 00010000:00010000:2.0:1787786258.295888:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: 00000000f4838edd/0x450132973bff1de4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1deb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.295897:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: 00000000f4838edd/0x450132973bff1de4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff1deb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786258.295969:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061bd2be7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5827:1874629686723072:0@lo:501: 00000100:00100000:2.0:1787786258.296004:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786258.296070:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686723072 00000100:00100000:3.0:1787786258.296074:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686723072 00000100:00100000:3.0:1787786258.296113:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787786258.296119:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000937bb525 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+6:5827:x1874629686723072:12345-0@lo:501: 00000100:00100000:3.0:1787786258.296347:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000937bb525 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+6:5827:x1874629686723072:12345-0@lo:501: Request processed in 228us (342us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787786258.296355:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787786258.300474:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 0000000023ad3051 going to sleep for 11 seconds 00000100:00100000:2.0:1787786258.300521:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061bd2be7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5827:1874629686723072:0@lo:501: 10000000:01000000:2.0:1787786258.300568:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787786258.300582:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: 00000000f4838edd/0x450132973bff1de4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1deb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.300593:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: 00000000f4838edd/0x450132973bff1de4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1deb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787786258.300601:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8b5207b73000 10000000:01000000:2.0:1787786258.300606:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787786258.300610:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8b5207b73000 10000000:01000000:2.0:1787786258.300613:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787786258.300615:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8b5207b73000 from 1 10000000:01000000:2.0:1787786258.300619:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787786258.300651:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: 000000003001e81d/0x450132973bff1df2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.300659:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: 000000003001e81d/0x450132973bff1df2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.300669:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: 000000003001e81d/0x450132973bff1df2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786258.300688:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061bd2be7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5827:1874629686723200:0@lo:101: 00000100:00100000:2.0:1787786258.300758:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786258.300819:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 0000000023ad3051 going to sleep for 11 seconds 00000100:00100000:0.0:1787786258.303132:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686723200 00000100:00100000:0.0:1787786258.303150:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686723200 00000100:00100000:0.0:1787786258.303246:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787786258.303257:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004002a432 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+6:5827:x1874629686723200:12345-0@lo:101: 00010000:00010000:0.0:1787786258.303276:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786258.303296:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001b829718/0x450132973bff1df9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff1df2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786258.303329:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001b829718/0x450132973bff1df9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff1df2 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786258.303340:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001b829718/0x450132973bff1df9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1df2 expref: 7 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786258.303361:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001b829718, rc 0) 00000100:00100000:0.0:1787786258.303447:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004002a432 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+7:5827:x1874629686723200:12345-0@lo:101: Request processed in 193us (2690us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786258.303465:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787786258.304398:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061bd2be7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5827:1874629686723200:0@lo:101: 00010000:00010000:2.0:1787786258.304420:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: 000000003001e81d/0x450132973bff1df2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1df9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.304441:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: 000000003001e81d/0x450132973bff1df2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff1df9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787786258.304472:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787786258.304491:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: 000000003001e81d/0x450132973bff1df2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1df9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.304499:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: 000000003001e81d/0x450132973bff1df2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1df9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787786258.304506:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787786258.304511:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787786258.304516:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8b5207b73000 10000000:01000000:2.0:1787786258.304519:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787786258.304523:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787786258.304526:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787786258.304550:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: 0000000055e943e1/0x450132973bff1e00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.304558:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: 0000000055e943e1/0x450132973bff1e00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.304567:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: 0000000055e943e1/0x450132973bff1e00 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786258.304585:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061bd2be7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5827:1874629686723328:0@lo:101: 00000100:00100000:2.0:1787786258.304630:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786258.304664:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686723328 00000100:00100000:1.0:1787786258.304670:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686723328 00000100:00100000:2.0:1787786258.304678:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 0000000023ad3051 going to sleep for 11 seconds 00000100:00100000:1.0:1787786258.304719:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787786258.304726:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005502309e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+7:5827:x1874629686723328:12345-0@lo:101: 00010000:00010000:1.0:1787786258.304741:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786258.304751:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e833164e/0x450132973bff1e07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff1e00 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786258.304767:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e833164e/0x450132973bff1e07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff1e00 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786258.304775:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e833164e/0x450132973bff1e07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1e00 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786258.304782:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e833164e, rc 0) 00000100:00100000:1.0:1787786258.304938:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005502309e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+8:5827:x1874629686723328:12345-0@lo:101: Request processed in 212us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786258.304946:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787786258.305778:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061bd2be7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5827:1874629686723328:0@lo:101: 00010000:00010000:2.0:1787786258.305835:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: 0000000055e943e1/0x450132973bff1e00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1e07 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.305846:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: 0000000055e943e1/0x450132973bff1e00 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff1e07 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786258.305922:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061bd2be7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5827:1874629686723456:0@lo:501: 00000100:00100000:2.0:1787786258.306132:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786258.306175:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 0000000023ad3051 going to sleep for 11 seconds 00000100:00100000:0.0:1787786258.307126:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686723456 00000100:00100000:0.0:1787786258.307136:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686723456 00000100:00100000:0.0:1787786258.307195:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787786258.307203:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de7e5928 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+8:5827:x1874629686723456:12345-0@lo:501: 00000100:00100000:0.0:1787786258.307536:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de7e5928 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+9:5827:x1874629686723456:12345-0@lo:501: Request processed in 334us (1405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786258.307544:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787786258.307650:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061bd2be7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5827:1874629686723456:0@lo:501: 00000100:00100000:3.0:1787786258.307697:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000006ca944 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5827:1874629686723584:0@lo:503: 00000100:00100000:3.0:1787786258.311507:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786258.311855:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000456d6bca going to sleep for 11 seconds 00000100:00100000:0.0:1787786258.315626:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686723584 00000100:00100000:0.0:1787786258.315648:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686723584 00000100:00100000:0.0:1787786258.315739:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787786258.315751:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1a8fe75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+9:5827:x1874629686723584:12345-0@lo:503: 00000100:00100000:0.0:1787786258.316124:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1a8fe75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+9:5827:x1874629686723584:12345-0@lo:503: Request processed in 374us (4626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786258.316134:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787786258.316184:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000006ca944 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5827:1874629686723584:0@lo:503: 00000100:00100000:3.0:1787786258.317208:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000006ca944 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5869:1874629686723712:0@lo:502: 00000100:00100000:3.0:1787786258.317295:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786258.317379:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set 0000000028773ec8 going to sleep for 11 seconds 00000100:00100000:2.0:1787786258.317527:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686723712 00000100:00100000:2.0:1787786258.317533:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686723712 00000100:00100000:2.0:1787786258.317579:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787786258.317587:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa76dba0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+9:5869:x1874629686723712:12345-0@lo:502: 00000100:00100000:2.0:1787786258.317877:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa76dba0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+9:5869:x1874629686723712:12345-0@lo:502: Request processed in 288us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786258.317888:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787786258.317997:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000006ca944 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5869:1874629686723712:0@lo:502: 00000020:01000000:0.0:1787786258.318033:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787786258.318046:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787786258.318048:0:5869:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787786258.318052:0:5869:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787786258.318055:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787786258.318079:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000000e42809a) 00000020:00000080:0.0:1787786258.318098:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787786258.318104:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787786258.318217:0:5869:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787786258.318224:0:5869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x450132973bff1e15 00000020:00000080:0.0:1787786258.318465:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787786258.318470:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787786258.318474:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787786258.318475:0:5869:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787786258.318477:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787786258.318481:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787786258.318482:0:5869:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787786258.318484:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787786258.318490:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000b75af81e) 00000020:00000080:0.0:1787786258.318498:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787786258.318502:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787786258.318503:0:5869:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787786258.318506:0:5869:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787786258.318511:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787786258.318552:0:5869:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000eb6be805 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787786258.318567:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000002d7d7eeb) 00000020:00000080:0.0:1787786258.318574:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787786258.318638:0:5869:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787786258.318651:0:5869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x450132973bff1e2a 00000020:00000080:0.0:1787786258.318748:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787786258.318754:0:5869:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787786258.318760:0:5869:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x450132973bff1e31 00080000:01000000:0.0:1787786258.318765:0:5869:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787786258.318769:0:5869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x450132973bff1e38 00080000:10000000:0.0:1787786258.319254:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1787786258.319438:0:5869:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1787786258.324702:0:5869:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787786258.429931:0:5869:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787786258.430510:0:5869:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787786258.436019:0:5869:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787786258.436978:0:5869:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787786258.478921:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000007170624f) 00000020:00000080:3.0:1787786258.478958:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787786258.479048:0:5869:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787786258.479072:0:5869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x450132973bff1e46 00000020:00000080:3.0:1787786258.480569:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1787786258.483587:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787786258.525325:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787786258.552408:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787786258.581415:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787786258.618710:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787786258.651572:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1787786258.679072:0:5869:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x450132973bff1e4d 00000020:00000080:2.0:1787786258.679413:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787786258.679424:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787786258.679429:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786258.679432:0:5869:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787786258.679434:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787786258.679445:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786258.679457:0:5869:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787786258.679462:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787786258.679495:0:5869:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1787786258.679508:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787786258.679511:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786258.679512:0:5869:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1787786258.679514:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787786258.679517:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786258.679518:0:5869:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787786258.679520:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787786258.679522:0:5869:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787786258.679564:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000150d1141 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5869:1874629686723840:0@lo:502: 00000100:00100000:2.0:1787786258.679653:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786258.679709:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dfc3255d going to sleep for 11 seconds 00000100:00100000:0.0:1787786258.679846:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686723840 00000100:00100000:0.0:1787786258.679854:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686723840 00000100:00100000:0.0:1787786258.679902:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787786258.679910:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008537821b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+9:5869:x1874629686723840:12345-0@lo:502: 00000100:00100000:0.0:1787786258.680247:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008537821b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+9:5869:x1874629686723840:12345-0@lo:502: Request processed in 336us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786258.680256:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787786258.680419:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000150d1141 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5869:1874629686723840:0@lo:502: 00000020:01000000:3.0:1787786258.680460:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787786258.680465:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787786258.680467:0:5869:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787786258.680471:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1787786258.680736:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1787786258.680755:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787786258.680774:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: 0000000055e943e1/0x450132973bff1e00 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1e07 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786258.680785:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: 0000000055e943e1/0x450132973bff1e00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1e07 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787786258.680830:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8b5207b73000 from 1 10000000:01000000:0.0:1787786258.680833:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787786258.680864:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: 000000008020268e/0x450132973bff1e54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786258.680879:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: 000000008020268e/0x450132973bff1e54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786258.680888:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: 000000008020268e/0x450132973bff1e54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786258.680908:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fea0f7bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5827:1874629686723968:0@lo:101: 00000100:00100000:0.0:1787786258.681034:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786258.681069:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e3dd165d going to sleep for 11 seconds 00000100:00100000:2.0:1787786258.681129:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686723968 00000100:00100000:2.0:1787786258.681134:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686723968 00000100:00100000:2.0:1787786258.681169:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787786258.681175:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051c0752e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+9:5827:x1874629686723968:12345-0@lo:101: 00010000:00010000:2.0:1787786258.681185:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786258.681197:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e909bade/0x450132973bff1e5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff1e54 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.681216:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e909bade/0x450132973bff1e5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff1e54 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.681225:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e909bade/0x450132973bff1e5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1e54 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.681232:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e909bade, rc 0) 00000100:00100000:2.0:1787786258.681261:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051c0752e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+10:5827:x1874629686723968:12345-0@lo:101: Request processed in 86us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786258.681274:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787786258.681356:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fea0f7bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5827:1874629686723968:0@lo:101: 00010000:00010000:0.0:1787786258.681368:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: 000000008020268e/0x450132973bff1e54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1e5b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786258.681376:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: 000000008020268e/0x450132973bff1e54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff1e5b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786258.682136:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fea0f7bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5827:1874629686724096:0@lo:256: 00000100:00100000:0.0:1787786258.682183:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786258.682257:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e3dd165d going to sleep for 11 seconds 00000100:00100000:2.0:1787786258.682458:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686724096 00000100:00100000:2.0:1787786258.682464:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686724096 00000100:00100000:2.0:1787786258.682504:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787786258.682511:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000618bf646 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+10:5827:x1874629686724096:12345-0@lo:256: 20000000:01000000:2.0:1787786258.682531:0:5840:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787786258.682537:0:5840:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787786258.682818:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000618bf646 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+10:5827:x1874629686724096:12345-0@lo:256: Request processed in 307us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786258.682826:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787786258.682957:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fea0f7bb pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5827:1874629686724096:0@lo:256: 10000000:01000000:1.0:1787786258.683556:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787786258.683631:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: 000000008020268e/0x450132973bff1e54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1e5b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786258.683643:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: 000000008020268e/0x450132973bff1e54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1e5b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787786258.683652:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b5207b73000 from 1 10000000:01000000:1.0:1787786258.683656:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787786258.683693:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: 000000003ec4dbcd/0x450132973bff1e62 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786258.683700:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: 000000003ec4dbcd/0x450132973bff1e62 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786258.683725:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: 000000003ec4dbcd/0x450132973bff1e62 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786258.683745:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000003207e59 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5827:1874629686724224:0@lo:101: 00000100:00100000:1.0:1787786258.683825:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786258.683853:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aaeb01c5 going to sleep for 11 seconds 00000100:00100000:2.0:1787786258.684073:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686724224 00000100:00100000:2.0:1787786258.684081:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686724224 00000100:00100000:2.0:1787786258.684130:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787786258.684138:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000184291bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+10:5827:x1874629686724224:12345-0@lo:101: 00010000:00010000:2.0:1787786258.684153:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786258.684169:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003da5fb7f/0x450132973bff1e69 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff1e62 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.684196:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003da5fb7f/0x450132973bff1e69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff1e62 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.684208:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003da5fb7f/0x450132973bff1e69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1e62 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.684218:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003da5fb7f, rc 0) 00000100:00100000:2.0:1787786258.684259:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000184291bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+11:5827:x1874629686724224:12345-0@lo:101: Request processed in 122us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786258.684266:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787786258.684387:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000003207e59 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5827:1874629686724224:0@lo:101: 00010000:00010000:1.0:1787786258.684403:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: 000000003ec4dbcd/0x450132973bff1e62 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1e69 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786258.684411:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: 000000003ec4dbcd/0x450132973bff1e62 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff1e69 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786258.684484:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000003207e59 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5827:1874629686724352:0@lo:501: 00000100:00100000:1.0:1787786258.684510:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786258.684578:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aaeb01c5 going to sleep for 11 seconds 00000100:00100000:0.0:1787786258.684854:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686724352 00000100:00100000:0.0:1787786258.684860:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686724352 00000100:00100000:0.0:1787786258.684887:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787786258.684896:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ff33c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+11:5827:x1874629686724352:12345-0@lo:501: 00000100:00100000:0.0:1787786258.685781:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ff33c71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+11:5827:x1874629686724352:12345-0@lo:501: Request processed in 884us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786258.685829:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787786258.686220:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000003207e59 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5827:1874629686724352:0@lo:501: 00000100:00100000:1.0:1787786258.686286:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000003207e59 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5827:1874629686724480:0@lo:503: 00000100:00100000:1.0:1787786258.686339:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786258.686378:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000aaeb01c5 going to sleep for 11 seconds 00000100:00100000:2.0:1787786258.686431:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686724480 00000100:00100000:2.0:1787786258.686437:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686724480 00000100:00100000:2.0:1787786258.686488:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787786258.686495:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e8e03ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+11:5827:x1874629686724480:12345-0@lo:503: 00000040:00080000:2.0:1787786258.686540:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787786258.686587:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e8e03ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+11:5827:x1874629686724480:12345-0@lo:503: Request processed in 92us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786258.686603:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787786258.686782:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000003207e59 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5827:1874629686724480:0@lo:503: 00000040:00080000:1.0:1787786258.687768:0:5874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1787786258.688202:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1787786258.688224:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787786258.688272:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: 000000003ec4dbcd/0x450132973bff1e62 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1e69 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.688283:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: 000000003ec4dbcd/0x450132973bff1e62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1e69 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787786258.688335:0:5827:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787786258.688339:0:5827:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8b5207b73000 10000000:01000000:2.0:1787786258.688342:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8b5207b73000 10000000:01000000:2.0:1787786258.688346:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787786258.688353:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8b5207b73000 from 1 10000000:01000000:2.0:1787786258.688356:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787786258.688388:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: 00000000df9319c0/0x450132973bff1e70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.688396:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: 00000000df9319c0/0x450132973bff1e70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.688406:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: 00000000df9319c0/0x450132973bff1e70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786258.688445:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b85bc818 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5827:1874629686724608:0@lo:101: 00000100:00100000:2.0:1787786258.688525:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786258.688569:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c55af1a0 going to sleep for 11 seconds 00000100:00100000:0.0:1787786258.688698:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686724608 00000100:00100000:0.0:1787786258.688704:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686724608 00000100:00100000:0.0:1787786258.688754:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787786258.688762:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e8c8ef0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+11:5827:x1874629686724608:12345-0@lo:101: 00010000:00010000:0.0:1787786258.688774:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786258.688785:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000015f8a0c2/0x450132973bff1e77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff1e70 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786258.688850:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000015f8a0c2/0x450132973bff1e77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff1e70 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786258.688859:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000015f8a0c2/0x450132973bff1e77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1e70 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786258.688866:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000015f8a0c2, rc 0) 00000100:00100000:0.0:1787786258.688900:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e8c8ef0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:5827:x1874629686724608:12345-0@lo:101: Request processed in 139us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786258.688906:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787786258.689097:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b85bc818 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5827:1874629686724608:0@lo:101: 00010000:00010000:2.0:1787786258.689110:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: 00000000df9319c0/0x450132973bff1e70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1e77 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.689118:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: 00000000df9319c0/0x450132973bff1e70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff1e77 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786258.689167:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b85bc818 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5827:1874629686724736:0@lo:501: 00000100:00100000:2.0:1787786258.689191:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786258.689218:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c55af1a0 going to sleep for 11 seconds 00000100:00100000:0.0:1787786258.689262:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686724736 00000100:00100000:0.0:1787786258.689266:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686724736 00000100:00100000:0.0:1787786258.689295:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787786258.689301:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053581c1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:5827:x1874629686724736:12345-0@lo:501: 00000100:00100000:0.0:1787786258.689574:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053581c1e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:5827:x1874629686724736:12345-0@lo:501: Request processed in 273us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786258.689581:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787786258.689686:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b85bc818 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5827:1874629686724736:0@lo:501: 00000100:00100000:1.0:1787786258.689715:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000003207e59 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5827:1874629686724864:0@lo:503: 00000100:00100000:1.0:1787786258.689759:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786258.689770:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000719a8225 going to sleep for 11 seconds 00000100:00100000:0.0:1787786258.689836:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686724864 00000100:00100000:0.0:1787786258.689840:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686724864 00000100:00100000:0.0:1787786258.689857:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787786258.689861:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000668ee779 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:5827:x1874629686724864:12345-0@lo:503: 00000100:00100000:1.0:1787786258.690501:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000668ee779 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:5827:x1874629686724864:12345-0@lo:503: Request processed in 637us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786258.690509:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787786258.690566:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000003207e59 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5827:1874629686724864:0@lo:503: 00000100:00100000:1.0:1787786258.691193:0:5875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000098abc97e pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5875:1874629686724992:0@lo:502: 00000100:00100000:1.0:1787786258.691241:0:5875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786258.691305:0:5875:0:(client.c:2715:ptlrpc_set_wait()) set 00000000614e0e4c going to sleep for 11 seconds 00000100:00100000:2.0:1787786258.691333:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686724992 00000100:00100000:2.0:1787786258.691337:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686724992 00000100:00100000:2.0:1787786258.691415:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787786258.691422:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2c91d1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:5875:x1874629686724992:12345-0@lo:502: 00000100:00100000:2.0:1787786258.691688:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2c91d1f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:5875:x1874629686724992:12345-0@lo:502: Request processed in 267us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786258.691696:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787786258.691765:0:5875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000098abc97e pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5875:1874629686724992:0@lo:502: 00000020:01000004:1.0:1787786258.691852:0:5875:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787786258.691876:0:5875:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000001a497a16) 00000020:00000080:1.0:1787786258.691896:0:5875:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1787786258.692007:0:5875:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000eb6be805 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787786258.692011:0:5875:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000eb6be805 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787786258.692014:0:5875:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000eb6be805 4 00010000:00080000:1.0:1787786258.692040:0:5875:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000009f50718@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.134@tcp at head 00010000:00010000:1.0:1787786258.693633:0:5875:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1787786258.693852:0:5875:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787786258.693891:0:5875:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787786258.693904:0:5875:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x450132973bff1e85 00000100:00080000:1.0:1787786258.693915:0:5875:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787786258.693920:0:5875:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000009f50718 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:1.0:1787786258.693956:0:5875:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000098abc97e x1874629686725120/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787786258.693999:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000098abc97e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874629686725120:0@lo:38: 00000100:00100000:1.0:1787786258.694079:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786258.694145:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686725120 00000100:00100000:1.0:1787786258.694160:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686725120 00000100:00100000:1.0:1787786258.694194:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787786258.694200:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000073d90b9e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874629686725120:12345-0@lo:38: 00000100:00100000:1.0:1787786258.694266:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000073d90b9e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874629686725120:12345-0@lo:38: Request processed in 64us (187us total) trans 0 rc -11/-11 00000100:00100000:1.0:1787786258.694274:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787786258.694309:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787786258.694316:0:3310:0:(import.c:65:import_set_state_nolock()) 0000000009f50718 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787786258.694330:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787786258.694333:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000098abc97e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874629686725120:0@lo:38: 00000100:00080000:1.0:1787786258.694368:0:5875:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787786258.699362:0:5875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000098abc97e pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5875:1874629686725248:0@lo:502: 00000100:00100000:1.0:1787786258.699466:0:5875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786258.699513:0:5875:0:(client.c:2715:ptlrpc_set_wait()) set 000000007ac9df9e going to sleep for 11 seconds 00000100:00100000:2.0:1787786258.700734:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686725248 00000100:00100000:2.0:1787786258.700744:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686725248 00000100:00100000:2.0:1787786258.700882:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787786258.700887:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000557c6fd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:5875:x1874629686725248:12345-0@lo:502: 00000100:00100000:2.0:1787786258.701126:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000557c6fd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:5875:x1874629686725248:12345-0@lo:502: Request processed in 238us (1661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786258.701134:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787786258.701200:0:5875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000098abc97e pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5875:1874629686725248:0@lo:502: 00000040:00080000:2.0:1787786258.701235:0:5875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1787786258.701353:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1787786258.701370:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787786258.701383:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: 00000000df9319c0/0x450132973bff1e70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1e77 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.701394:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: 00000000df9319c0/0x450132973bff1e70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1e77 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787786258.701439:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787786258.701441:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787786258.701443:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787786258.701444:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787786258.701445:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787786258.701457:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787786258.701459:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787786258.701460:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787786258.701461:0:5827:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787786258.701463:0:5827:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787786258.701464:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787786258.701466:0:5827:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787786258.701469:0:5827:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1787786258.701475:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787786258.701477:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787786258.701478:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787786258.701479:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787786258.701480:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787786258.701481:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787786258.701482:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787786258.701483:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787786258.701489:0:5827:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787786258.701489:0:5827:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787786258.701490:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787786258.701491:0:5827:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787786258.701511:0:5827:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787786258.701527:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051cf6d93 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5827:1874629686725376:0@lo:253: 00000100:00100000:2.0:1787786258.701560:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786258.701740:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686725376 00000100:00100000:0.0:1787786258.701745:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686725376 00000100:00100000:0.0:1787786258.701781:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787786258.701788:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078764954 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:5827:x1874629686725376:12345-0@lo:253: 20000000:01000000:0.0:1787786258.701824:0:5839:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787786258.701851:0:5839:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787786258.703941:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ba9889c1 going to sleep for 11 seconds 20000000:01000000:0.0:1787786258.742510:0:5839:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787786258.742532:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787786258.742672:0:5862:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787786258.742679:0:5862:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787786258.742703:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005fa4965e/0x450132973bff1e8c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.742726:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e909bade/0x450132973bff1e5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1e54 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.742735:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005fa4965e/0x450132973bff1e8c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.742781:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e909bade/0x450132973bff1e5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff1e54 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.743061:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e909bade/0x450132973bff1e5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff1e54 expref: 12 pid: 5839 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786258.743078:0:5862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004896575c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5862:1874629686725504:0@lo:104: 00000100:00100000:2.0:1787786258.743147:0:5862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786258.743211:0:5862:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c55af1a0 going to sleep for 11 seconds 00000100:00100000:1.0:1787786258.743383:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686725504 00000100:00100000:1.0:1787786258.743392:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686725504 00000100:00100000:1.0:1787786258.743443:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787786258.743463:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000012abf77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+3:5862:x1874629686725504:12345-0@lo:104: 00010000:00010000:1.0:1787786258.743475:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: 000000008020268e/0x450132973bff1e54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1e5b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786258.743536:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787786258.743540:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000012abf77 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+3:5862:x1874629686725504:12345-0@lo:104: Request processed in 79us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786258.743547:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787786258.743569:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787786258.743573:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: 000000008020268e/0x450132973bff1e54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1e5b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786258.743735:0:5862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004896575c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5862:1874629686725504:0@lo:104: 00010000:00010000:0.0:1787786258.743755:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005fa4965e/0x450132973bff1e8c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786258.743820:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008020268e already unused, calling callback (0000000017582da1) 10000000:00010000:1.0:1787786258.743824:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: 000000008020268e/0x450132973bff1e54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff1e5b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786258.743830:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: 000000008020268e/0x450132973bff1e54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff1e5b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787786258.743835:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: 000000008020268e/0x450132973bff1e54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff1e5b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787786258.743840:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787786258.743872:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: 000000008020268e/0x450132973bff1e54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1e5b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786258.743878:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787786258.743895:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: 000000008020268e/0x450132973bff1e54 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1e5b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786258.743900:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: 000000008020268e/0x450132973bff1e54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1e5b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786258.743918:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786258.743920:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786258.743922:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786258.744143:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000098abc97e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686725632:0@lo:103: 00000100:00100000:0.0:1787786258.744179:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786258.744283:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686725632 00000100:00100000:2.0:1787786258.744289:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686725632 00010000:00010000:2.0:1787786258.744313:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e909bade/0x450132973bff1e5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1e54 expref: 13 pid: 5839 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786258.744356:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787786258.744365:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7615d83 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:3312:x1874629686725632:12345-0@lo:103: 00010000:00010000:2.0:1787786258.744378:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787786258.744382:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e909bade/0x450132973bff1e5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1e54 expref: 13 pid: 5839 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.744392:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e909bade/0x450132973bff1e5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff1e54 expref: 13 pid: 5839 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.744409:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e909bade/0x450132973bff1e5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff1e54 expref: 13 pid: 5839 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.744424:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005fa4965e/0x450132973bff1e8c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.744438:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005fa4965e/0x450132973bff1e8c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787786258.744467:0:5831:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001788518s 00010000:00010000:2.0:1787786258.744471:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005fa4965e/0x450132973bff1e8c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.744478:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005fa4965e/0x450132973bff1e8c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.744486:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005fa4965e/0x450132973bff1e8c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.744492:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005fa4965e/0x450132973bff1e8c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.744504:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005fa4965e already unused, calling callback (0000000068ef859f) 00010000:00010000:2.0:1787786258.744509:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005fa4965e/0x450132973bff1e8c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.744515:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005fa4965e/0x450132973bff1e8c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.744527:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005fa4965e/0x450132973bff1e8c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786258.744536:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787786258.744567:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7615d83 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:3312:x1874629686725632:12345-0@lo:103: Request processed in 204us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786258.744573:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787786258.744773:0:5862:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005fa4965e/0x450132973bff1e8c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786258.744780:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005fa4965e/0x450132973bff1e8c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786258.744785:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005fa4965e/0x450132973bff1e8c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786258.744840:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000098abc97e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686725632:0@lo:103: 00000100:00100000:3.0:1787786258.752862:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078764954 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+11:5827:x1874629686725376:12345-0@lo:253: Request processed in 51066us (51293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786258.752897:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787786258.753194:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051cf6d93 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5827:1874629686725376:0@lo:253: 10000000:01000000:0.0:1787786258.753211:0:5827:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787786258.753214:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787786258.753216:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787786258.753224:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787786258.753226:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787786258.753227:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787786258.753229:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787786258.753230:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787786258.753232:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787786258.753233:0:5827:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787786258.753234:0:5827:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787786258.753236:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787786258.753237:0:5827:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787786258.753256:0:5827:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787786258.766561:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787786258.767681:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787786258.768143:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1787786258.768404:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787786258.768684:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787786258.769096:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787786258.771261:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787786258.771716:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787786258.772152:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787786258.772486:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787786258.772875:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787786258.773236:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1787786258.814347:0:5827:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1787786258.848706:0:5827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1787786258.849112:0:5881:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1787786258.854848:0:5827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1787786258.855064:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1787786258.855575:0:5827:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787786258.855583:0:5827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787786258.855712:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787786258.856670:0:5827:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000020:00080000:0.0:1787786258.858378:0:5880:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1787786258.858387:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:3.0:1787786258.864156:0:5827:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787786258.864251:0:5827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787786258.864564:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787786258.867014:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1787786258.874859:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1787786258.875109:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787786258.875281:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787786258.875437:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1787786258.875592:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787786258.875740:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787786258.875914:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787786258.876068:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787786258.876216:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787786258.876357:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787786258.876535:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787786258.876674:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787786258.876861:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1787786258.877002:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1787786258.877156:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1787786258.877284:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1787786258.883781:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1787786258.883992:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1787786258.884178:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1787786258.884332:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1787786258.884508:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1787786258.884647:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1787786258.884820:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1787786258.884961:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1787786258.885095:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1787786258.885207:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1787786258.885352:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1787786258.885501:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1787786258.885648:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1787786258.885776:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1787786258.885957:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00010000:00010000:3.0:1787786258.895978:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1787786258.896866:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1787786258.897141:0:5827:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1787786258.927212:0:5881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1787786259.027159:0:5827:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1787786259.027209:0:5827:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb4ac01cab988 00100000:10000000:1.0:1787786259.027221:0:5827:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787786259.028278:0:5827:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787786259.028308:0:5827:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.134@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787786259.028468:0:5827:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787786259.028516:0:5827:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1787786259.084761:0:5881:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787786259.084891:0:5881:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:2.0:1787786259.084896:0:5881:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1787786259.913982:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786260.937924:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786261.963283:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786262.987003:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787786263.049997:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1787786263.050011:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8b5207b73000 from 3 10000000:01000000:3.0:1787786263.050016:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787786263.050081:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: 000000005587efaf/0x450132973bff1e93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786263.050117:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: 000000005587efaf/0x450132973bff1e93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786263.050131:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: 000000005587efaf/0x450132973bff1e93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786263.050163:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000df12ef2f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686725760:0@lo:101: 00000100:00100000:3.0:1787786263.050250:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786263.050316:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set 0000000095b33e68 going to sleep for 11 seconds 00000100:00100000:1.0:1787786263.050412:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686725760 00000100:00100000:1.0:1787786263.050423:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686725760 00000100:00100000:1.0:1787786263.050481:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787786263.050489:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007a23f18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+11:5843:x1874629686725760:12345-0@lo:101: 00010000:00010000:1.0:1787786263.050504:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786263.050517:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000013ccfc48/0x450132973bff1e9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff1e93 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786263.050539:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000013ccfc48/0x450132973bff1e9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff1e93 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786263.050549:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000013ccfc48/0x450132973bff1e9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1e93 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786263.050557:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000013ccfc48, rc 0) 00000100:00100000:1.0:1787786263.050609:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007a23f18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:5843:x1874629686725760:12345-0@lo:101: Request processed in 121us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786263.050616:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787786263.050710:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000df12ef2f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686725760:0@lo:101: 00010000:00010000:0.0:1787786263.050725:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: 000000005587efaf/0x450132973bff1e93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1e9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786263.050733:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: 000000005587efaf/0x450132973bff1e93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff1e9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786263.050817:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000027f7d43d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686725888:0@lo:256: 00000100:00100000:0.0:1787786263.050850:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786263.050875:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a3c71504 going to sleep for 11 seconds 00000100:00100000:3.0:1787786263.050937:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686725888 00000100:00100000:3.0:1787786263.050942:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686725888 00000100:00100000:3.0:1787786263.051020:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787786263.051027:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051610126 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:5843:x1874629686725888:12345-0@lo:256: 20000000:01000000:3.0:1787786263.051043:0:5839:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787786263.051074:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787786263.051077:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1787786263.051152:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051610126 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:5843:x1874629686725888:12345-0@lo:256: Request processed in 126us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786263.051160:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787786263.051253:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000027f7d43d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686725888:0@lo:256: 10000000:01000000:1.0:1787786263.051292:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787786263.051298:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: 000000005587efaf/0x450132973bff1e93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1e9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786263.051306:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: 000000005587efaf/0x450132973bff1e93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1e9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:2.0:1787786264.000620:0:6123:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg434-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787786264.011165:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787786264.074909:0:481:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787786264.074919:0:481:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787786264.074922:0:481:0:(import.c:65:import_set_state_nolock()) 0000000009f50718 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787786264.074936:0:481:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000009f50718 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:1.0:1787786264.074962:0:481:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000075214df6 x1874629686726144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787786264.075042:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ae282713 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686726016:0@lo:400: 00000100:00100000:2.0:1787786264.075127:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786264.075435:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000075214df6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874629686726144:0@lo:38: 00000100:00100000:0.0:1787786264.075531:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786264.075642:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686726144 00000100:00100000:2.0:1787786264.075650:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686726144 00000100:00100000:2.0:1787786264.075691:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787786264.075697:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091c71801 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1874629686726144:12345-0@lo:38: 00010000:00080000:2.0:1787786264.075722:0:5848:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:2.0:1787786264.075769:0:5848:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x450132973bff1ea1 00000004:00100000:2.0:1787786264.075842:0:5848:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1787786264.075985:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686726016 00000100:00100000:1.0:1787786264.075990:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686726016 00000100:00080000:3.0:1787786264.075995:0:5848:0:(import.c:65:import_set_state_nolock()) 0000000016724c53 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787786264.076031:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787786264.076040:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebeb81b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:3313:x1874629686726016:12345-0@lo:400: 00000100:00100000:3.0:1787786264.076053:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091c71801 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874629686726144:12345-0@lo:38: Request processed in 354us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786264.076066:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787786264.076088:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebeb81b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:3313:x1874629686726016:12345-0@lo:400: Request processed in 48us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786264.076095:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1787786264.076190:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000075214df6 x1874629686726144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787786274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787786264.076205:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787786264.076212:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787786264.076217:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787786264.076219:0:3310:0:(import.c:65:import_set_state_nolock()) 0000000009f50718 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787786264.076224:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000075214df6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874629686726144:0@lo:38: 00000100:00100000:2.0:1787786264.076505:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ae282713 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686726016:0@lo:400: 00010000:00010000:0.0:1787786265.034023:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786266.072019:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786267.082303:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786268.110740:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786269.130962:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786269.201182:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787786269.201207:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e690e228 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874629686726400:0@lo:400: 00000100:00100000:0.0:1787786269.201285:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786269.201394:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787786269.201404:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000866337e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686726272:0@lo:400: 00000100:00100000:1.0:1787786269.201441:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786269.201497:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686726400 00000100:00100000:1.0:1787786269.201505:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686726400 00000100:00100000:1.0:1787786269.201561:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787786269.201571:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8bb09e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874629686726400:12345-0@lo:400: 00000100:00100000:1.0:1787786269.201648:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8bb09e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874629686726400:12345-0@lo:400: Request processed in 79us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786269.201657:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787786269.201706:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e690e228 x1874629686726400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787786285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786269.201722:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e690e228 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874629686726400:0@lo:400: 00000100:00100000:0.0:1787786269.201977:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686726272 00000100:00100000:0.0:1787786269.201982:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686726272 00000100:00100000:0.0:1787786269.202015:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787786269.202020:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f088dd45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:3313:x1874629686726272:12345-0@lo:400: 00000100:00100000:0.0:1787786269.202061:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f088dd45 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:3313:x1874629686726272:12345-0@lo:400: Request processed in 41us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786269.202067:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787786269.202138:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000866337e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686726272:0@lo:400: 00000020:00000080:3.0:1787786269.428651:0:6325:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdbccd0770 20000000:00000080:3.0:1787786269.428670:0:6325:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8b52091a3800 uarg=0000000000000000 20000000:01000000:3.0:1787786269.428707:0:6325:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787786269.428721:0:6325:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787786269.428728:0:6325:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787786269.429251:0:6325:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1787786269.429264:0:6325:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1787786269.433069:0:6325:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787786269.433364:0:6325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787786269.433418:0:6325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1787786269.433461:0:6325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1787786269.433479:0:6325:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787786269.433500:0:6325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005fa4965e/0x450132973bff1ea8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786269.433521:0:6325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003da5fb7f/0x450132973bff1e69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1e62 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786269.433528:0:6325:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005fa4965e/0x450132973bff1ea8 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786269.433573:0:6325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003da5fb7f/0x450132973bff1e69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff1e62 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786269.433589:0:6325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003da5fb7f/0x450132973bff1e69 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff1e62 expref: 11 pid: 5839 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786269.433604:0:6325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000026ab14a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6325:1874629686726528:0@lo:104: 00000100:00100000:2.0:1787786269.438179:0:6325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786269.438265:0:6325:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ba9889c1 going to sleep for 11 seconds 00000100:00100000:0.0:1787786269.438292:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686726528 00000100:00100000:0.0:1787786269.438303:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686726528 00000100:00100000:0.0:1787786269.438361:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787786269.438369:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003bd59539 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+3:6325:x1874629686726528:12345-0@lo:104: 00010000:00010000:0.0:1787786269.438385:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: 000000003ec4dbcd/0x450132973bff1e62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1e69 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786269.438459:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787786269.438463:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003bd59539 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+3:6325:x1874629686726528:12345-0@lo:104: Request processed in 97us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786269.438470:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787786269.438764:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787786269.438771:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: 000000003ec4dbcd/0x450132973bff1e62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1e69 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786269.438779:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003ec4dbcd already unused, calling callback (0000000017582da1) 10000000:00010000:3.0:1787786269.438782:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: 000000003ec4dbcd/0x450132973bff1e62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff1e69 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786269.438819:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: 000000003ec4dbcd/0x450132973bff1e62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff1e69 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787786269.438825:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: 000000003ec4dbcd/0x450132973bff1e62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff1e69 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786269.438831:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787786269.438866:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: 000000003ec4dbcd/0x450132973bff1e62 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1e69 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786269.438872:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787786269.438887:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: 000000003ec4dbcd/0x450132973bff1e62 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1e69 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786269.438892:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: 000000003ec4dbcd/0x450132973bff1e62 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1e69 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786269.438911:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786269.438913:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786269.438914:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786269.440382:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fe904844 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686726656:0@lo:103: 00000100:00100000:0.0:1787786269.440452:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786269.440543:0:6325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000026ab14a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6325:1874629686726528:0@lo:104: 00010000:00010000:2.0:1787786269.440575:0:6325:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005fa4965e/0x450132973bff1ea8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786269.440590:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686726656 00000100:00100000:3.0:1787786269.440603:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686726656 00010000:00010000:3.0:1787786269.440633:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003da5fb7f/0x450132973bff1e69 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1e62 expref: 12 pid: 5839 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786269.440670:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787786269.440678:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033913047 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:3312:x1874629686726656:12345-0@lo:103: 00010000:00010000:3.0:1787786269.440695:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786269.440699:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003da5fb7f/0x450132973bff1e69 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1e62 expref: 12 pid: 5839 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786269.440710:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003da5fb7f/0x450132973bff1e69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff1e62 expref: 12 pid: 5839 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786269.440739:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003da5fb7f/0x450132973bff1e69 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff1e62 expref: 12 pid: 5839 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786269.440755:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005fa4965e/0x450132973bff1ea8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786269.440761:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005fa4965e/0x450132973bff1ea8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786269.440776:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005fa4965e/0x450132973bff1ea8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786269.440782:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005fa4965e/0x450132973bff1ea8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786269.440787:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005fa4965e/0x450132973bff1ea8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786269.440818:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005fa4965e/0x450132973bff1ea8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786269.440832:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005fa4965e already unused, calling callback (0000000068ef859f) 00010000:00010000:3.0:1787786269.440836:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005fa4965e/0x450132973bff1ea8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786269.440842:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005fa4965e/0x450132973bff1ea8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786269.440856:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005fa4965e/0x450132973bff1ea8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786269.440866:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787786269.440905:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033913047 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+11:3312:x1874629686726656:12345-0@lo:103: Request processed in 227us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786269.440911:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787786269.440941:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fe904844 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686726656:0@lo:103: 00010000:00010000:0.0:1787786269.441541:0:6325:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005fa4965e/0x450132973bff1ea8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786269.441551:0:6325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005fa4965e/0x450132973bff1ea8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786269.441557:0:6325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005fa4965e/0x450132973bff1ea8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786270.158176:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786271.185248:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786272.202735:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787786272.459377:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787786272.459387:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b5207b73000 from 1 10000000:01000000:0.0:1787786272.459393:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787786272.459448:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: 000000001a9d645f/0x450132973bff1eaf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786272.459476:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: 000000001a9d645f/0x450132973bff1eaf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786272.459488:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: 000000001a9d645f/0x450132973bff1eaf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786272.459513:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f861984e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686726784:0@lo:101: 00000100:00100000:0.0:1787786272.459604:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786272.459672:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set 000000002b77d1e1 going to sleep for 11 seconds 00000100:00100000:2.0:1787786272.459743:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686726784 00000100:00100000:2.0:1787786272.459754:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686726784 00000100:00100000:2.0:1787786272.459832:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787786272.459843:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e93c54db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+11:5843:x1874629686726784:12345-0@lo:101: 00010000:00010000:2.0:1787786272.459862:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786272.459879:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e909bade/0x450132973bff1eb6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff1eaf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786272.459907:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e909bade/0x450132973bff1eb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff1eaf expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786272.459919:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e909bade/0x450132973bff1eb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1eaf expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786272.459929:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e909bade, rc 0) 00000100:00100000:2.0:1787786272.459978:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e93c54db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:5843:x1874629686726784:12345-0@lo:101: Request processed in 137us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786272.459984:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787786272.461157:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f861984e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686726784:0@lo:101: 00010000:00010000:0.0:1787786272.461194:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: 000000001a9d645f/0x450132973bff1eaf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1eb6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786272.461226:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: 000000001a9d645f/0x450132973bff1eaf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff1eb6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786272.461304:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f861984e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686726912:0@lo:501: 00000100:00100000:0.0:1787786272.461353:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786272.461401:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set 000000002b77d1e1 going to sleep for 11 seconds 00000100:00100000:3.0:1787786272.461721:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686726912 00000100:00100000:3.0:1787786272.461728:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686726912 00000100:00100000:3.0:1787786272.461770:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787786272.461777:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003fa10241 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:5843:x1874629686726912:12345-0@lo:501: 00000100:00100000:3.0:1787786272.462013:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003fa10241 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:5843:x1874629686726912:12345-0@lo:501: Request processed in 223us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786272.462022:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787786272.462232:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f861984e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686726912:0@lo:501: 00000100:00100000:0.0:1787786272.462266:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f861984e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686727040:0@lo:503: 00000100:00100000:0.0:1787786272.462306:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786272.462336:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set 000000002b77d1e1 going to sleep for 11 seconds 00000100:00100000:3.0:1787786272.463102:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686727040 00000100:00100000:3.0:1787786272.463110:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686727040 00000100:00100000:3.0:1787786272.463150:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787786272.463158:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d85a4cac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:5843:x1874629686727040:12345-0@lo:503: 00000100:00100000:3.0:1787786272.463357:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d85a4cac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:5843:x1874629686727040:12345-0@lo:503: Request processed in 200us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786272.463445:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787786272.464140:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f861984e pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686727040:0@lo:503: 00000100:00100000:2.0:1787786272.476976:0:6546:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000026ab14a pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6546:1874629686727168:0@lo:502: 00000100:00100000:2.0:1787786272.477094:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786272.477155:0:6546:0:(client.c:2715:ptlrpc_set_wait()) set 000000005ed37f86 going to sleep for 11 seconds 00000100:00100000:1.0:1787786272.477291:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686727168 00000100:00100000:1.0:1787786272.477299:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686727168 00000100:00100000:1.0:1787786272.477354:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787786272.477373:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7f511a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:6546:x1874629686727168:12345-0@lo:502: 00000100:00100000:1.0:1787786272.477621:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7f511a4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:6546:x1874629686727168:12345-0@lo:502: Request processed in 250us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786272.477630:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787786272.479074:0:6546:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000026ab14a pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6546:1874629686727168:0@lo:502: 00000020:01000000:2.0:1787786272.479130:0:6546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787786272.479153:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786272.479155:0:6546:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787786272.479164:0:6546:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b5207b73000 00000020:00000080:2.0:1787786272.479166:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787786272.479234:0:6546:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b1de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6546:1874629686727296:0@lo:502: 00000100:00100000:2.0:1787786272.479299:0:6546:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786272.479341:0:6546:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52337ab540 going to sleep for 11 seconds 00000100:00100000:1.0:1787786272.479494:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686727296 00000100:00100000:1.0:1787786272.479501:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686727296 00000100:00100000:1.0:1787786272.479545:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787786272.479552:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:6546:x1874629686727296:12345-0@lo:502: 00000100:00100000:1.0:1787786272.479767:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:6546:x1874629686727296:12345-0@lo:502: Request processed in 214us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786272.479776:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787786272.480722:0:6546:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b1de00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6546:1874629686727296:0@lo:502: 00000020:01000000:3.0:1787786272.480757:0:6546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787786272.480766:0:6546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787786272.480768:0:6546:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787786272.480773:0:6546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1787786272.481008:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787786272.481040:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787786272.481052:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b5200030400/0x450132973bff1eaf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1eb6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786272.481065:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b5200030400/0x450132973bff1eaf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1eb6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786273.227832:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786274.252408:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786274.317182:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b1c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686727552:0@lo:400: 00000100:00100000:2.0:1787786274.317263:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786274.317324:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787786274.317331:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3314:1874629686727424:0@lo:400: 00000100:00100000:2.0:1787786274.317359:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786274.317398:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686727552 00000100:00100000:2.0:1787786274.317405:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686727552 00000100:00100000:2.0:1787786274.317456:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787786274.317464:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686727552:12345-0@lo:400: 00000100:00100000:2.0:1787786274.317511:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686727552:12345-0@lo:400: Request processed in 48us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786274.317519:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787786274.317545:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686727424 00000100:00100000:2.0:1787786274.317548:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686727424 00000100:00100000:2.0:1787786274.317574:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787786274.317581:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:3314:x1874629686727424:12345-0@lo:400: 00000100:00100000:2.0:1787786274.317610:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:3314:x1874629686727424:12345-0@lo:400: Request processed in 30us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786274.317617:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787786274.317665:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3314:1874629686727424:0@lo:400: 00010000:00080000:2.0:1787786274.317704:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8b5221b1c3c0 x1874629686727552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787786290 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786274.317716:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b1c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686727552:0@lo:400: 00010000:00010000:1.0:1787786275.274709:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787786275.595048:0:6696:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787786275.595054:0:6696:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1787786275.595215:0:6696:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8b5206233000 00000020:01000004:3.0:1787786275.595231:0:6696:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787786275.595596:0:6696:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787786275.595683:0:6696:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8b5206790000) 00000020:00000080:3.0:1787786275.595701:0:6696:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787786275.613494:0:6696:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787786275.614087:0:6696:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1787786275.636306:0:6696:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787786275.641772:0:6696:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787786275.641989:0:6696:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787786275.642054:0:6696:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787786275.642081:0:6696:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787786275.642465:0:6696:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787786275.642478:0:6696:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787786275.642490:0:6696:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x450132973bff1ec4 00000020:01000004:2.0:1787786275.642498:0:6696:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787786275.642519:0:6696:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.134@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787786275.642523:0:6696:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787786275.642532:0:6696:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787786275.642537:0:6696:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787786275.642547:0:6696:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8b52090a8000) 00000020:00000080:2.0:1787786275.642556:0:6696:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1787786275.644066:0:6696:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787786275.644253:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787786275.644259:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787786275.644980:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787786275.644989:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787786275.645622:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787786275.645636:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787786275.647737:0:6696:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787786275.648098:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787786275.648105:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787786275.649519:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787786275.649531:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787786275.673047:0:6696:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787786275.673292:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1787786275.673299:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1787786275.679364:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1787786275.679379:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1787786275.680745:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787786275.680758:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787786275.683601:0:6696:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787786275.684220:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787786275.684229:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787786275.685244:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787786275.685255:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787786275.731929:0:6696:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787786275.732215:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787786275.732222:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787786275.734353:0:6696:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787786275.734371:0:6696:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1787786275.735257:0:6696:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1787786275.735288:0:6696:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1787786275.735295:0:6696:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.134@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787786275.754671:0:6696:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.134@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787786275.754712:0:6696:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.134@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1787786275.754716:0:6696:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787786275.754718:0:6696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787786275.754719:0:6696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787786275.754725:0:6696:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787786275.754727:0:6696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787786275.754728:0:6696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787786275.754729:0:6696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787786275.754730:0:6696:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787786275.754731:0:6696:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787786275.754733:0:6696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787786275.754734:0:6696:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787786275.754738:0:6696:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1787786275.754740:0:6696:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787786275.754741:0:6696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787786275.754743:0:6696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787786275.754744:0:6696:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787786275.754744:0:6696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787786275.754745:0:6696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787786275.754746:0:6696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787786275.754747:0:6696:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787786275.754748:0:6696:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787786275.754748:0:6696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787786275.754749:0:6696:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787786275.754988:0:6696:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787786275.755013:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b30f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686727680:0@lo:253: 00000100:00100000:1.0:1787786275.755095:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786275.755206:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52304be9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787786275.755293:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686727680 00000100:00100000:2.0:1787786275.755301:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686727680 00000100:00100000:2.0:1787786275.755401:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787786275.755412:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:6696:x1874629686727680:12345-0@lo:253: 20000000:01000000:2.0:1787786275.755451:0:5840:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787786275.755456:0:5840:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1787786275.755462:0:5840:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1787786275.755467:0:5840:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1787786275.756437:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787786275.756655:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1787786275.756670:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1787786275.756706:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1787786275.756714:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1787786275.756741:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1787786275.756829:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1787786275.757230:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1787786275.757250:0:5840:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.134@tcp 20000000:01000000:2.0:1787786275.757252:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.134@tcp (null) (null) (null) 00000040:00080000:2.0:1787786275.757285:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1787786275.757294:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787786275.757341:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1787786275.757351:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.134@tcp (null) (null) 00000040:00080000:2.0:1787786275.757383:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1787786275.757394:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787786275.757425:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1787786275.757473:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1787786275.758463:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1787786275.758486:0:5840:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.134@tcp 20000000:01000000:2.0:1787786275.758488:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.134@tcp (null) (null) (null) 00000040:00080000:2.0:1787786275.758526:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1787786275.758534:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787786275.758577:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1787786275.758586:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.134@tcp (null) (null) 00000040:00080000:2.0:1787786275.758639:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1787786275.758651:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787786275.758683:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1787786275.758719:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1787786275.758740:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787786275.758744:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787786275.758749:0:5840:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787786275.758765:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787786275.758768:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787786275.759191:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787786275.759194:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787786275.759749:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1787786275.760208:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1787786275.760253:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1787786275.760326:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1787786275.760340:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787786275.760342:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787786275.761009:0:6712:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1787786275.761064:0:6712:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1787786275.761128:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1787786275.762328:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1787786275.762385:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1787786275.762467:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1787786275.762485:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787786275.762488:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787786275.763222:0:6713:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1787786275.763290:0:6713:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1787786275.763340:0:6713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1787786275.763664:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1787786275.763709:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1787786275.763741:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1787786275.763758:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1787786275.763761:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1787786275.763771:0:5840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787786275.764039:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b520151aa00/0x450132973bff1ed2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.764058:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b52421d5a00/0x450132973bff1deb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1de4 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.764076:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b5201677400/0x450132973bff1e07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1e00 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.764084:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b5200031c00/0x450132973bff1e77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1e70 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.764093:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b520151aa00/0x450132973bff1ed2 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.764142:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b5200031c00/0x450132973bff1e77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff1e70 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.764158:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b5200031c00/0x450132973bff1e77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff1e70 expref: 12 pid: 5839 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786275.764174:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b1c3c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1874629686727808:0@lo:104: 00000100:00100000:2.0:1787786275.764241:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787786275.764385:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b5201677400/0x450132973bff1e07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff1e00 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.764395:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b5201677400/0x450132973bff1e07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff1e00 expref: 12 pid: 5840 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786275.764404:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b1cf00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1874629686727936:0@lo:104: 00000100:00100000:2.0:1787786275.764427:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787786275.764551:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b52421d5a00/0x450132973bff1deb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff1de4 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.764561:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b52421d5a00/0x450132973bff1deb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff1de4 expref: 12 pid: 5839 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786275.764576:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b1f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1874629686728064:0@lo:104: 00000100:00100000:2.0:1787786275.764599:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786275.764617:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686727808 00000100:00100000:0.0:1787786275.764623:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686727808 00000100:00100000:1.0:1787786275.764678:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686727936 00000100:00100000:1.0:1787786275.764682:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686727936 00000100:00100000:1.0:1787786275.764703:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787786275.764711:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b1c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+4:5840:x1874629686727808:12345-0@lo:104: 00010000:00010000:1.0:1787786275.764722:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff8b520151b000/0x450132973bff1e70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1e77 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.764777:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787786275.764815:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b1c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+4:5840:x1874629686727808:12345-0@lo:104: Request processed in 105us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786275.764823:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787786275.764849:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787786275.764856:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+3:5840:x1874629686727936:12345-0@lo:104: 00010000:00010000:1.0:1787786275.764864:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff8b520151b600/0x450132973bff1e00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1e07 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.764896:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787786275.764900:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+3:5840:x1874629686727936:12345-0@lo:104: Request processed in 46us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786275.764906:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1787786275.764925:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787786275.764930:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b520151b000/0x450132973bff1e70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1e77 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.764937:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520151b000 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1787786275.764942:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b520151b000/0x450132973bff1e70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff1e77 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.764949:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b520151b000/0x450132973bff1e70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff1e77 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787786275.764956:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b520151b000/0x450132973bff1e70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff1e77 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787786275.764961:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787786275.764990:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b520151b000/0x450132973bff1e70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1e77 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.764996:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787786275.765015:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b520151b000/0x450132973bff1e70 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1e77 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.765032:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b520151b000/0x450132973bff1e70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1e77 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.765045:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787786275.765048:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b520151b600/0x450132973bff1e00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1e07 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.765053:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520151b600 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1787786275.765056:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b520151b600/0x450132973bff1e00 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff1e07 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.765062:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b520151b600/0x450132973bff1e00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff1e07 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787786275.765067:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b520151b600/0x450132973bff1e00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff1e07 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787786275.765072:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787786275.765086:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b520151b600/0x450132973bff1e00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1e07 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.765091:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787786275.765096:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b520151b600/0x450132973bff1e00 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1e07 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.765103:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b520151b600/0x450132973bff1e00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1e07 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.765112:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786275.765131:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786275.765133:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786275.765168:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686728192:0@lo:103: 00000100:00100000:1.0:1787786275.765199:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786275.765222:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787786275.765227:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686728320:0@lo:103: 00000100:00100000:1.0:1787786275.765246:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786275.765283:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686728192 00000100:00100000:1.0:1787786275.765287:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686728192 00010000:00010000:1.0:1787786275.765305:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b5200031c00/0x450132973bff1e77 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1e70 expref: 13 pid: 5839 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786275.765331:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686728320 00000100:00100000:1.0:1787786275.765334:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686728320 00010000:00010000:1.0:1787786275.765345:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b5201677400/0x450132973bff1e07 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1e00 expref: 14 pid: 5840 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786275.765359:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787786275.765365:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b303c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:3311:x1874629686728192:12345-0@lo:103: 00010000:00010000:1.0:1787786275.765375:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786275.765380:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b5200031c00/0x450132973bff1e77 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1e70 expref: 14 pid: 5839 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.765389:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b5200031c00/0x450132973bff1e77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff1e70 expref: 14 pid: 5839 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.765406:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786275.765433:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b303c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:3311:x1874629686728192:12345-0@lo:103: Request processed in 69us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786275.765440:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787786275.765461:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787786275.765467:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b30780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:3311:x1874629686728320:12345-0@lo:103: 00010000:00010000:1.0:1787786275.765474:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786275.765479:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b5201677400/0x450132973bff1e07 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1e00 expref: 13 pid: 5840 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.765487:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b5201677400/0x450132973bff1e07 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff1e00 expref: 13 pid: 5840 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.765497:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786275.765519:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b30780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:3311:x1874629686728320:12345-0@lo:103: Request processed in 52us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786275.765526:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787786275.765560:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686728320:0@lo:103: 00000100:00100000:1.0:1787786275.765567:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686728192:0@lo:103: 00010000:00010000:3.0:1787786275.765736:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786275.765864:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686728064 00000100:00100000:2.0:1787786275.765868:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686728064 00000100:00100000:2.0:1787786275.765889:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787786275.765895:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b1de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+3:5840:x1874629686728064:12345-0@lo:104: 00010000:00010000:2.0:1787786275.765904:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff8b520151be00/0x450132973bff1de4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1deb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.765941:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787786275.765946:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b1de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+3:5840:x1874629686728064:12345-0@lo:104: Request processed in 52us (1346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786275.765952:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787786275.765969:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787786275.765973:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b520151be00/0x450132973bff1de4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1deb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.765980:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520151be00 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:2.0:1787786275.765983:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b520151be00/0x450132973bff1de4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff1deb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.765990:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b520151be00/0x450132973bff1de4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff1deb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787786275.765996:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b520151be00/0x450132973bff1de4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff1deb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787786275.766001:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787786275.766046:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b520151be00/0x450132973bff1de4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1deb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.766053:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787786275.766070:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b520151be00/0x450132973bff1de4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1deb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.766076:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b520151be00/0x450132973bff1de4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1deb expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.766092:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786275.766094:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786275.766096:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786275.766108:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686728448:0@lo:103: 00000100:00100000:2.0:1787786275.766150:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786275.766197:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686728448 00000100:00100000:2.0:1787786275.766201:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686728448 00010000:00010000:2.0:1787786275.766231:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b52421d5a00/0x450132973bff1deb lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1de4 expref: 13 pid: 5839 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786275.766249:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787786275.766257:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:3313:x1874629686728448:12345-0@lo:103: 00010000:00010000:2.0:1787786275.766264:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787786275.766269:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b52421d5a00/0x450132973bff1deb lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1de4 expref: 13 pid: 5839 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.766278:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b52421d5a00/0x450132973bff1deb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff1de4 expref: 13 pid: 5839 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.766292:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b520151aa00/0x450132973bff1ed2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.766306:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b520151aa00/0x450132973bff1ed2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.766322:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b520151aa00/0x450132973bff1ed2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.766329:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b520151aa00/0x450132973bff1ed2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.766336:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b520151aa00/0x450132973bff1ed2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.766342:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b520151aa00/0x450132973bff1ed2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.766347:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520151aa00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:2.0:1787786275.766350:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b520151aa00/0x450132973bff1ed2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.766357:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b520151aa00/0x450132973bff1ed2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.766365:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b520151aa00/0x450132973bff1ed2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.766373:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787786275.766403:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:3313:x1874629686728448:12345-0@lo:103: Request processed in 148us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786275.766410:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787786275.766437:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686728448:0@lo:103: 00000100:00100000:2.0:1787786275.766467:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52090dd3c0 going to sleep for 11 seconds 00010000:00010000:2.0:1787786275.766480:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5200031c00/0x450132973bff1e77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff1e70 expref: 12 pid: 5839 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786275.766491:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b1c3c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1874629686727808:0@lo:104: 00010000:00010000:2.0:1787786275.766501:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5201677400/0x450132973bff1e07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff1e00 expref: 11 pid: 5840 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786275.766511:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b1cf00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1874629686727936:0@lo:104: 00010000:00010000:2.0:1787786275.766519:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b52421d5a00/0x450132973bff1deb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff1de4 expref: 10 pid: 5839 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786275.766528:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b1f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1874629686728064:0@lo:104: 00010000:00010000:2.0:1787786275.766549:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b520151aa00/0x450132973bff1ed2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.766557:0:5840:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b520151aa00/0x450132973bff1ed2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.766563:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b520151aa00/0x450132973bff1ed2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.766569:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b520151aa00/0x450132973bff1ed2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787786275.766581:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1787786275.801318:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+9:6696:x1874629686727680:12345-0@lo:253: Request processed in 45901us (46215us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786275.801332:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787786275.801521:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b30f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686727680:0@lo:253: 10000000:01000000:2.0:1787786275.801538:0:6696:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787786275.801542:0:6696:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787786275.801556:0:6696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787786275.801557:0:6696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787786275.801559:0:6696:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1787786275.801560:0:6696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787786275.801562:0:6696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787786275.801563:0:6696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787786275.801565:0:6696:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787786275.801566:0:6696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787786275.801568:0:6696:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787786275.801590:0:6696:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8b5206233000 from lustre-OST0000 10000000:01000000:2.0:1787786275.801627:0:6696:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787786275.801630:0:6696:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787786275.801638:0:6696:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8b52090acd28 local copy 10000000:01000000:2.0:1787786275.801643:0:6696:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787786275.801677:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520151aa00/0x450132973bff1ed9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.801687:0:6696:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.134@tcp lock: ffff8b520151aa00/0x450132973bff1ed9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.801696:0:6696:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b520151aa00/0x450132973bff1ed9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786275.801716:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c09e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686728576:0@lo:101: 00000100:00100000:2.0:1787786275.801751:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786275.801843:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52090ddb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787786275.801988:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686728576 00000100:00100000:3.0:1787786275.801995:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686728576 00000100:00100000:3.0:1787786275.802039:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787786275.802050:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+9:6696:x1874629686728576:12345-0@lo:101: 00010000:00010000:3.0:1787786275.802063:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786275.802077:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b52421d4400/0x450132973bff1ee0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff1ed9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786275.802111:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b52421d4400/0x450132973bff1ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff1ed9 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786275.802134:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b52421d4400/0x450132973bff1ee0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1ed9 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786275.802143:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d4400, rc 0) 00000100:00100000:3.0:1787786275.802185:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+10:6696:x1874629686728576:12345-0@lo:101: Request processed in 138us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786275.802192:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787786275.802308:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c09e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686728576:0@lo:101: 00010000:00010000:2.0:1787786275.802320:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b520151aa00/0x450132973bff1ed9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x450132973bff1ee0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.802330:0:6696:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b520151aa00/0x450132973bff1ed9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x450132973bff1ee0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786275.802442:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c09e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686728704:0@lo:501: 00000100:00100000:2.0:1787786275.802467:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786275.802493:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52090ddb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787786275.802547:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686728704 00000100:00100000:3.0:1787786275.802551:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686728704 00000100:00100000:3.0:1787786275.802584:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787786275.802591:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+10:6696:x1874629686728704:12345-0@lo:501: 00000100:00100000:3.0:1787786275.803039:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+10:6696:x1874629686728704:12345-0@lo:501: Request processed in 446us (569us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787786275.803047:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787786275.803177:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c09e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686728704:0@lo:501: 10000000:01000000:2.0:1787786275.803194:0:6696:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787786275.803225:0:6696:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787786275.803231:0:6696:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520151aa00/0x450132973bff1ed9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x450132973bff1ee0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.803241:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520151aa00/0x450132973bff1ed9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x450132973bff1ee0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.803249:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.134@tcp lock: ffff8b520151aa00/0x450132973bff1ed9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x450132973bff1ee0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.803308:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787786275.803327:0:6696:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8b5206233000 10000000:01000000:2.0:1787786275.803332:0:6696:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787786275.803337:0:6696:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8b52090acd28 10000000:01000000:2.0:1787786275.803340:0:6696:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787786275.803343:0:6696:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8b52090acd28 from 1 10000000:01000000:2.0:1787786275.803346:0:6696:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787786275.803368:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520151be00/0x450132973bff1ee7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.803376:0:6696:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b520151be00/0x450132973bff1ee7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.803396:0:6696:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b520151be00/0x450132973bff1ee7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786275.803410:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c09e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686728832:0@lo:101: 00000100:00100000:2.0:1787786275.803437:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786275.803468:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52090dda80 going to sleep for 11 seconds 00000100:00100000:0.0:1787786275.803524:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686728832 00000100:00100000:0.0:1787786275.803529:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686728832 00000100:00100000:0.0:1787786275.803564:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787786275.803572:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+10:6696:x1874629686728832:12345-0@lo:101: 00010000:00010000:0.0:1787786275.803580:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786275.803593:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5200030c00/0x450132973bff1eee lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff1ee7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786275.803634:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5200030c00/0x450132973bff1eee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff1ee7 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786275.803644:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5200030c00/0x450132973bff1eee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1ee7 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786275.803653:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5200030c00, rc 0) 00000100:00100000:0.0:1787786275.803742:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+11:6696:x1874629686728832:12345-0@lo:101: Request processed in 170us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786275.803748:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:3.0:1787786275.803930:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787786275.803937:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b520151aa00/0x450132973bff1ed9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x450132973bff1ee0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786275.803945:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520151aa00 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:3.0:1787786275.803948:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b520151aa00/0x450132973bff1ed9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x450132973bff1ee0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786275.803957:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b520151aa00/0x450132973bff1ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x450132973bff1ee0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787786275.803977:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b520151aa00/0x450132973bff1ed9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x450132973bff1ee0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786275.803983:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787786275.804007:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b520151aa00/0x450132973bff1ed9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x450132973bff1ee0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786275.804014:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787786275.804068:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3314:1874629686728960:0@lo:103: 00000100:00100000:2.0:1787786275.804107:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787786275.804173:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b520151aa00/0x450132973bff1ed9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x450132973bff1ee0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786275.804182:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b520151aa00/0x450132973bff1ed9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x450132973bff1ee0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786275.804200:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786275.804201:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786275.804203:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786275.804260:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686728960 00000100:00100000:0.0:1787786275.804266:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686728960 00000100:00100000:0.0:1787786275.804314:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787786275.804322:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+11:3314:x1874629686728960:12345-0@lo:103: 00010000:00010000:0.0:1787786275.804331:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787786275.804345:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b52421d4400/0x450132973bff1ee0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x450132973bff1ed9 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786275.804358:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786275.804463:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c09e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686728832:0@lo:101: 00010000:00010000:1.0:1787786275.804477:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b520151be00/0x450132973bff1ee7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1eee expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.804486:0:6696:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b520151be00/0x450132973bff1ee7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff1eee expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787786275.804507:0:6696:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787786275.804526:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520151be00/0x450132973bff1ee7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1eee expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.804533:0:6696:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b520151be00/0x450132973bff1ee7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1eee expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787786275.804554:0:6696:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787786275.804559:0:6696:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787786275.804565:0:6696:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787786275.804567:0:6696:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787786275.804586:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b5201676a00/0x450132973bff1ef5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.804593:0:6696:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b5201676a00/0x450132973bff1ef5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.804600:0:6696:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b5201676a00/0x450132973bff1ef5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786275.804625:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b330c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686729088:0@lo:101: 00000100:00100000:1.0:1787786275.804657:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786275.804672:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52086a9480 going to sleep for 11 seconds 00000100:00100000:3.0:1787786275.804734:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686729088 00000100:00100000:3.0:1787786275.804738:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686729088 00000100:00100000:3.0:1787786275.804777:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787786275.804784:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+11:6696:x1874629686729088:12345-0@lo:101: 00010000:00010000:3.0:1787786275.804829:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786275.804858:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b52421d5400/0x450132973bff1efc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff1ef5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786275.804875:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b52421d5400/0x450132973bff1efc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff1ef5 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786275.804884:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b52421d5400/0x450132973bff1efc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1ef5 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786275.804896:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d5400, rc 0) 00000100:00100000:3.0:1787786275.804932:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:6696:x1874629686729088:12345-0@lo:101: Request processed in 148us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786275.804937:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787786275.805000:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b330c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686729088:0@lo:101: 00010000:00010000:3.0:1787786275.805012:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b5201676a00/0x450132973bff1ef5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1efc expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786275.805019:0:6696:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b5201676a00/0x450132973bff1ef5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff1efc expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786275.805153:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686729216:0@lo:501: 00000100:00100000:3.0:1787786275.805196:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786275.805219:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52089d9300 going to sleep for 11 seconds 00000100:00100000:1.0:1787786275.805349:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686729216 00000100:00100000:1.0:1787786275.805353:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686729216 00000100:00100000:1.0:1787786275.805384:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787786275.805390:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:6696:x1874629686729216:12345-0@lo:501: 00000100:00100000:1.0:1787786275.805632:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:6696:x1874629686729216:12345-0@lo:501: Request processed in 241us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786275.805639:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787786275.805762:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686729216:0@lo:501: 00000100:00100000:3.0:1787786275.805832:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686729344:0@lo:503: 00000100:00100000:3.0:1787786275.805873:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786275.805891:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52089d9300 going to sleep for 11 seconds 00000100:00100000:1.0:1787786275.805948:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686729344 00000100:00100000:1.0:1787786275.805952:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686729344 00000100:00100000:1.0:1787786275.805982:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787786275.805989:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:6696:x1874629686729344:12345-0@lo:503: 00000100:00100000:1.0:1787786275.806150:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:6696:x1874629686729344:12345-0@lo:503: Request processed in 161us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786275.806156:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787786275.806230:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686729344:0@lo:503: 00000040:00080000:3.0:1787786275.806525:0:6696:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787786275.806591:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686729472:0@lo:502: 00000100:00100000:3.0:1787786275.806642:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786275.806666:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52089d9300 going to sleep for 11 seconds 00000100:00100000:1.0:1787786275.806778:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686729472 00000100:00100000:1.0:1787786275.806782:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686729472 00000100:00100000:1.0:1787786275.806838:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787786275.806845:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:6696:x1874629686729472:12345-0@lo:502: 00000100:00100000:1.0:1787786275.807005:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:6696:x1874629686729472:12345-0@lo:502: Request processed in 160us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786275.807012:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787786275.807196:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686729472:0@lo:502: 00000040:00080000:3.0:1787786275.807417:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787786275.807463:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787786275.807497:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787786275.807549:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787786275.807587:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787786275.807637:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787786275.807664:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686729600:0@lo:502: 00000100:00100000:3.0:1787786275.807701:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786275.807722:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52089d9300 going to sleep for 11 seconds 00000100:00100000:0.0:1787786275.808061:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+11:3314:x1874629686728960:12345-0@lo:103: Request processed in 3738us (3952us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786275.808070:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787786275.808157:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686729600 00000100:00100000:1.0:1787786275.808163:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686729600 00000100:00100000:1.0:1787786275.808197:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787786275.808205:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+11:6696:x1874629686729600:12345-0@lo:502: 00000100:00100000:1.0:1787786275.808371:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+11:6696:x1874629686729600:12345-0@lo:502: Request processed in 165us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786275.808378:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787786275.808509:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9e1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686729600:0@lo:502: 00000040:00080000:0.0:1787786275.808626:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787786275.808637:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1787786275.809266:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787786275.809277:0:6714:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1787786275.809284:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787786275.809287:0:6714:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787786275.809292:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787786275.809310:0:6714:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8b52091219b8) 00000020:00000080:1.0:1787786275.809332:0:6714:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787786275.809338:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787786275.809430:0:6714:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b5206233000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787786275.809438:0:6714:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787786275.809445:0:6714:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x450132973bff1f0a 00000100:00100000:2.0:1787786275.811949:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3314:1874629686728960:0@lo:103: 00010000:00010000:3.0:1787786275.818214:0:6714:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1787786275.818565:0:6714:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1787786275.821408:0:6714:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787786275.821731:0:6714:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1787786275.831345:0:6714:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787786275.832379:0:6714:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1787786275.833985:0:6714:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787786275.834005:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787786275.834011:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787786275.834014:0:6714:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787786275.834017:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787786275.834021:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787786275.834023:0:6714:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787786275.834026:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787786275.834028:0:6714:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787786275.834085:0:6714:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787786275.834088:0:6714:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787786275.834089:0:6714:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787786275.834093:0:6714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787786275.834260:0:6696:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1787786275.834290:0:6696:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787786275.834313:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b5201676a00/0x450132973bff1ef5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1efc expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786275.834325:0:6696:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b5201676a00/0x450132973bff1ef5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1efc expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786275.834334:0:6696:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b5206233000 from 1 10000000:01000000:3.0:1787786275.834337:0:6696:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787786275.834374:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b52421d5c00/0x450132973bff1f11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786275.834381:0:6696:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b52421d5c00/0x450132973bff1f11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786275.834404:0:6696:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b52421d5c00/0x450132973bff1f11 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786275.834428:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686729728:0@lo:101: 00000100:00100000:3.0:1787786275.834494:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786275.834538:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5213404d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787786275.838601:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686729728 00000100:00100000:1.0:1787786275.838684:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686729728 00000100:00100000:1.0:1787786275.838739:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787786275.838747:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+11:6696:x1874629686729728:12345-0@lo:101: 00010000:00010000:1.0:1787786275.838761:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786275.838775:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5201677a00/0x450132973bff1f18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff1f11 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.838812:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5201677a00/0x450132973bff1f18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff1f11 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.838821:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5201677a00/0x450132973bff1f18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1f11 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.838827:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5201677a00, rc 0) 00000100:00100000:1.0:1787786275.839062:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:6696:x1874629686729728:12345-0@lo:101: Request processed in 314us (4567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786275.839070:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787786275.840261:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686729728:0@lo:101: 00010000:00010000:0.0:1787786275.840296:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b52421d5c00/0x450132973bff1f11 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1f18 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786275.840331:0:6696:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b52421d5c00/0x450132973bff1f11 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff1f18 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786275.840473:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205314f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686729856:0@lo:501: 00000100:00100000:0.0:1787786275.840532:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786275.840579:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5232addcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787786275.840914:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686729856 00000100:00100000:3.0:1787786275.840922:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686729856 00000100:00100000:3.0:1787786275.840969:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787786275.840978:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:6696:x1874629686729856:12345-0@lo:501: 00000100:00100000:3.0:1787786275.842027:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:6696:x1874629686729856:12345-0@lo:501: Request processed in 1043us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786275.842037:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787786275.843600:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205314f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686729856:0@lo:501: 00000100:00100000:0.0:1787786275.843666:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205314f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686729984:0@lo:503: 00000100:00100000:0.0:1787786275.843743:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786275.843811:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5232addcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787786275.844163:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686729984 00000100:00100000:2.0:1787786275.844181:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686729984 00000100:00100000:2.0:1787786275.844327:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787786275.844338:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:6696:x1874629686729984:12345-0@lo:503: 00000100:00100000:2.0:1787786275.845550:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:6696:x1874629686729984:12345-0@lo:503: Request processed in 1207us (1802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786275.845564:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787786275.846342:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205314f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686729984:0@lo:503: 00000040:00080000:0.0:1787786275.846662:0:6696:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787786275.846741:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205314f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686730112:0@lo:502: 00000100:00100000:0.0:1787786275.846846:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786275.846916:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686730112 00000100:00100000:3.0:1787786275.846923:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686730112 00000100:00100000:3.0:1787786275.846975:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787786275.846985:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:6696:x1874629686730112:12345-0@lo:502: 00000100:00100000:0.0:1787786275.848024:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5232addcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787786275.848040:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:6696:x1874629686730112:12345-0@lo:502: Request processed in 1054us (1192us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786275.848051:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787786275.848056:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205314f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686730112:0@lo:502: 00000040:00080000:0.0:1787786275.848588:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1787786275.848648:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1787786275.848686:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205314f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686730240:0@lo:502: 00000100:00100000:0.0:1787786275.848738:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786275.848885:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5232addcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787786275.849062:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686730240 00000100:00100000:2.0:1787786275.849069:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686730240 00000100:00100000:2.0:1787786275.849200:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787786275.849210:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:6696:x1874629686730240:12345-0@lo:502: 00000100:00100000:2.0:1787786275.849643:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:6696:x1874629686730240:12345-0@lo:502: Request processed in 433us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786275.849653:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787786275.849733:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205314f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686730240:0@lo:502: 00000040:00080000:0.0:1787786275.850158:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1787786275.850171:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787786275.850783:0:6718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787786275.850852:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786275.850875:0:6718:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787786275.850885:0:6718:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b5206233000 00000020:00000080:2.0:1787786275.850887:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787786275.850912:0:6718:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787786275.850915:0:6718:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786275.850917:0:6718:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787786275.850920:0:6718:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1787786275.851330:0:6696:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787786275.851353:0:6696:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787786275.851386:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b52421d5c00/0x450132973bff1f11 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1f18 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786275.851399:0:6696:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b52421d5c00/0x450132973bff1f11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1f18 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787786275.851439:0:6696:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787786275.851443:0:6696:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8b5206233000 10000000:01000000:0.0:1787786275.851446:0:6696:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8b5206233000 10000000:01000000:0.0:1787786275.851451:0:6696:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787786275.851461:0:6696:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8b5206233000 from 1 10000000:01000000:0.0:1787786275.851465:0:6696:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787786275.851502:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b5200031c00/0x450132973bff1f1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786275.851511:0:6696:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b5200031c00/0x450132973bff1f1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786275.851523:0:6696:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b5200031c00/0x450132973bff1f1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786275.851547:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205314f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686730368:0@lo:101: 00000100:00100000:0.0:1787786275.851612:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786275.851784:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5232adde40 going to sleep for 11 seconds 00000100:00100000:2.0:1787786275.853774:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686730368 00000100:00100000:2.0:1787786275.854022:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686730368 00000100:00100000:2.0:1787786275.854191:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787786275.854203:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:6696:x1874629686730368:12345-0@lo:101: 00010000:00010000:2.0:1787786275.854227:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786275.854254:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b520151b400/0x450132973bff1f26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff1f1f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.854291:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b520151b400/0x450132973bff1f26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff1f1f expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.854304:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b520151b400/0x450132973bff1f26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1f1f expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.854505:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520151b400, rc 0) 00000100:00100000:2.0:1787786275.854646:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:6696:x1874629686730368:12345-0@lo:101: Request processed in 445us (3032us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786275.854654:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787786275.854735:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205314f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686730368:0@lo:101: 00010000:00010000:0.0:1787786275.854754:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b5200031c00/0x450132973bff1f1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1f26 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786275.854785:0:6696:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b5200031c00/0x450132973bff1f1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff1f26 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786275.855400:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205314f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686730496:0@lo:501: 00000100:00100000:0.0:1787786275.855443:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786275.855482:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5232adde40 going to sleep for 11 seconds 00000100:00100000:1.0:1787786275.855615:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686730496 00000100:00100000:1.0:1787786275.855629:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686730496 00000100:00100000:1.0:1787786275.855672:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787786275.855682:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:6696:x1874629686730496:12345-0@lo:501: 00000100:00100000:1.0:1787786275.855967:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:6696:x1874629686730496:12345-0@lo:501: Request processed in 285us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786275.855975:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787786275.856206:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205314f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686730496:0@lo:501: 00000100:00100000:0.0:1787786275.856239:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205314f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686730624:0@lo:503: 00000100:00100000:0.0:1787786275.856280:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786275.856314:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5232adde40 going to sleep for 11 seconds 00000100:00100000:3.0:1787786275.856534:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686730624 00000100:00100000:3.0:1787786275.856539:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686730624 00000100:00100000:3.0:1787786275.856567:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787786275.856575:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:6696:x1874629686730624:12345-0@lo:503: 00000100:00100000:3.0:1787786275.856731:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:6696:x1874629686730624:12345-0@lo:503: Request processed in 156us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786275.856747:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787786275.856846:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205314f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686730624:0@lo:503: 00000040:00080000:0.0:1787786275.857175:0:6696:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787786275.857246:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205314f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686730752:0@lo:502: 00000100:00100000:0.0:1787786275.857286:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786275.857328:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5232adde40 going to sleep for 11 seconds 00000100:00100000:1.0:1787786275.857685:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686730752 00000100:00100000:1.0:1787786275.857692:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686730752 00000100:00100000:1.0:1787786275.857725:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787786275.857733:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:6696:x1874629686730752:12345-0@lo:502: 00000100:00100000:1.0:1787786275.857957:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:6696:x1874629686730752:12345-0@lo:502: Request processed in 224us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786275.857965:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787786275.858253:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205314f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686730752:0@lo:502: 00000040:00080000:0.0:1787786275.858722:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787786275.858781:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787786275.858859:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787786275.858993:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787786275.859030:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787786275.860502:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787786275.860594:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787786275.860627:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787786275.860694:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787786275.860730:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787786275.860763:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787786275.861234:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787786275.861284:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787786275.861478:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787786275.861542:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787786275.861578:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787786275.861608:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787786275.861653:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787786275.861689:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787786275.861723:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787786275.861768:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787786275.862177:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787786275.862221:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787786275.862271:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787786275.862307:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787786275.862502:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787786275.862553:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787786275.862588:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1787786275.862636:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686730880:0@lo:502: 00000100:00100000:3.0:1787786275.862719:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786275.862856:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5213404180 going to sleep for 11 seconds 00000100:00100000:1.0:1787786275.863174:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686730880 00000100:00100000:1.0:1787786275.863182:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686730880 00000100:00100000:1.0:1787786275.863261:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787786275.863272:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:6696:x1874629686730880:12345-0@lo:502: 00000100:00100000:1.0:1787786275.863523:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:6696:x1874629686730880:12345-0@lo:502: Request processed in 254us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786275.863532:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787786275.863625:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9d680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686730880:0@lo:502: 00000040:00080000:0.0:1787786275.863724:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787786275.863736:0:6696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1787786275.865014:0:6719:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787786275.865041:0:6719:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8b523c200000) 00000020:00000080:0.0:1787786275.865060:0:6719:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1787786275.865149:0:6719:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b5206233000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787786275.865153:0:6719:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8b5206233000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787786275.865156:0:6719:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b5206233000 3 00010000:00080000:0.0:1787786275.865199:0:6719:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b51013a3000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.134@tcp at head 00010000:00010000:0.0:1787786275.874081:0:6719:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1787786275.874418:0:6719:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787786275.874457:0:6719:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787786275.874471:0:6719:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x450132973bff1f34 00000100:00080000:0.0:1787786275.874482:0:6719:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787786275.874488:0:6719:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b51013a3000 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:0.0:1787786275.874521:0:6719:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5205314f00 x1874629686731008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787786275.874547:0:6719:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000040:00080000:0.0:1787786275.874831:0:6719:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:3.0:1787786275.876033:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787786275.876061:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874629686731136:0@lo:400: 00000100:00100000:3.0:1787786275.876316:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786275.876691:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205314f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874629686731008:0@lo:38: 00000100:00100000:2.0:1787786275.876732:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1787786275.876786:0:6696:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1787786275.876850:0:6696:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787786275.876875:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b5200031c00/0x450132973bff1f1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1f26 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.876893:0:6696:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b5200031c00/0x450132973bff1f1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1f26 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787786275.876942:0:6696:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787786275.876945:0:6696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787786275.876946:0:6696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787786275.876947:0:6696:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787786275.876949:0:6696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787786275.876950:0:6696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787786275.876952:0:6696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787786275.876954:0:6696:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787786275.876955:0:6696:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787786275.876957:0:6696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787786275.876958:0:6696:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787786275.876962:0:6696:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1787786275.876964:0:6696:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787786275.876966:0:6696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787786275.876967:0:6696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787786275.876968:0:6696:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787786275.876969:0:6696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787786275.876970:0:6696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787786275.876971:0:6696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787786275.876972:0:6696:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787786275.876973:0:6696:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787786275.876974:0:6696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787786275.876975:0:6696:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787786275.876995:0:6696:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787786275.877007:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c08780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686731264:0@lo:253: 00000100:00100000:2.0:1787786275.877040:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786275.877055:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5101130c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787786275.877286:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686731136 00000100:00100000:0.0:1787786275.877294:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686731136 00000100:00100000:0.0:1787786275.877355:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686731008 00000100:00100000:2.0:1787786275.877495:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787786275.877508:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221a9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874629686731136:12345-0@lo:400: 00000100:00100000:2.0:1787786275.877568:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221a9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874629686731136:12345-0@lo:400: Request processed in 63us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786275.877584:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787786275.877628:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686731008 00000100:00100000:0.0:1787786275.877659:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787786275.877665:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874629686731008:12345-0@lo:38: 00010000:00080000:0.0:1787786275.877686:0:5846:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:0.0:1787786275.877719:0:5846:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x450132973bff1f3b 00000004:00100000:0.0:1787786275.877735:0:5846:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787786275.877770:0:5846:0:(import.c:65:import_set_state_nolock()) ffff8b51013a2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787786275.877842:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874629686731008:12345-0@lo:38: Request processed in 176us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786275.877859:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787786275.877994:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686731264 00000100:00100000:0.0:1787786275.877999:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686731264 00000100:00100000:0.0:1787786275.878033:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787786275.878040:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:6696:x1874629686731264:12345-0@lo:253: 20000000:01000000:0.0:1787786275.878074:0:5840:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787786275.878090:0:5840:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1787786275.878566:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8b5221a9d680 x1874629686731136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787786291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786275.878583:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874629686731136:0@lo:400: 00010000:00080000:2.0:1787786275.878866:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8b5205314f00 x1874629686731008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787786285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786275.878886:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787786275.878894:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1787786275.878902:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787786275.878908:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787786275.878911:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b51013a3000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787786275.878918:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205314f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874629686731008:0@lo:38: 20000000:01000000:3.0:1787786275.941109:0:5840:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787786275.941143:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787786275.941331:0:5862:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787786275.941336:0:5862:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787786275.941490:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b520151a800/0x450132973bff1f42 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.941510:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b5201676400/0x450132973bff1e9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1e93 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.941519:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b520151a800/0x450132973bff1f42 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.941562:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b5201676400/0x450132973bff1e9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff1e93 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786275.941578:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b5201676400/0x450132973bff1e9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff1e93 expref: 13 pid: 5841 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786275.941595:0:5862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c08b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5862:1874629686731392:0@lo:104: 00000100:00100000:2.0:1787786275.941673:0:5862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786275.941758:0:5862:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5101130cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787786275.941819:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686731392 00000100:00100000:2.0:1787786275.941826:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686731392 00000100:00100000:1.0:1787786275.942774:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787786275.942815:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c08f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+3:5862:x1874629686731392:12345-0@lo:104: 00010000:00010000:1.0:1787786275.942832:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff8b52421d4c00/0x450132973bff1e93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1e9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.942923:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787786275.942929:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c08f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+3:5862:x1874629686731392:12345-0@lo:104: Request processed in 144us (1258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786275.942947:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1787786275.942991:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787786275.942997:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b52421d4c00/0x450132973bff1e93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1e9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786275.943002:0:5862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c08b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5862:1874629686731392:0@lo:104: 00010000:00010000:1.0:1787786275.943010:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d4c00 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1787786275.943016:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b52421d4c00/0x450132973bff1e93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff1e9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.943026:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b52421d4c00/0x450132973bff1e93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff1e9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786275.943029:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b520151a800/0x450132973bff1f42 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787786275.943038:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b52421d4c00/0x450132973bff1e93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff1e9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787786275.943047:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787786275.943079:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b52421d4c00/0x450132973bff1e93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1e9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.943086:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787786275.943129:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b52421d4c00/0x450132973bff1e93 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1e9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.943137:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b52421d4c00/0x450132973bff1e93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1e9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.943156:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786275.943158:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786275.943159:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786275.943227:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686731520:0@lo:103: 00000100:00100000:3.0:1787786275.943271:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786275.945521:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686731520 00000100:00100000:1.0:1787786275.945553:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686731520 00010000:00010000:1.0:1787786275.945595:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b5201676400/0x450132973bff1e9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1e93 expref: 14 pid: 5841 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786275.945638:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787786275.945647:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5207bdc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:3312:x1874629686731520:12345-0@lo:103: 00010000:00010000:1.0:1787786275.945662:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786275.945668:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b5201676400/0x450132973bff1e9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1e93 expref: 14 pid: 5841 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.945681:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b5201676400/0x450132973bff1e9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff1e93 expref: 14 pid: 5841 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.945704:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5201676400/0x450132973bff1e9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff1e93 expref: 14 pid: 5841 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.945723:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b520151a800/0x450132973bff1f42 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.945732:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b520151a800/0x450132973bff1f42 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787786275.945750:0:5832:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004414317s 00010000:00010000:1.0:1787786275.945755:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b520151a800/0x450132973bff1f42 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.945762:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b520151a800/0x450132973bff1f42 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.945769:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b520151a800/0x450132973bff1f42 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.945787:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b520151a800/0x450132973bff1f42 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.945816:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520151a800 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:1.0:1787786275.945821:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b520151a800/0x450132973bff1f42 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.945830:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b520151a800/0x450132973bff1f42 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.945856:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b520151a800/0x450132973bff1f42 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786275.945867:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786275.945941:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5207bdc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:3312:x1874629686731520:12345-0@lo:103: Request processed in 295us (2668us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786275.945949:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1787786275.945998:0:5862:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b520151a800/0x450132973bff1f42 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786275.946009:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b520151a800/0x450132973bff1f42 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786275.946016:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b520151a800/0x450132973bff1f42 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786275.946026:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686731520:0@lo:103: 00000100:00100000:1.0:1787786275.971527:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:6696:x1874629686731264:12345-0@lo:253: Request processed in 93477us (94475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786275.971556:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787786275.971974:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c08780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:6696:1874629686731264:0@lo:253: 10000000:01000000:2.0:1787786275.972073:0:6696:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787786275.972076:0:6696:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787786275.972078:0:6696:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787786275.972080:0:6696:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787786275.972081:0:6696:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787786275.972083:0:6696:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787786275.972084:0:6696:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787786275.972086:0:6696:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787786275.972087:0:6696:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787786275.972089:0:6696:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787786275.972090:0:6696:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787786275.972092:0:6696:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787786275.972109:0:6696:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787786275.980200:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787786275.981558:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787786275.983379:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787786275.983620:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787786275.983891:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787786275.987287:0:6696:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787786275.989632:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787786276.206230:0:6696:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787786276.206237:0:6696:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787786276.206288:0:6696:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787786276.206352:0:6696:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.134@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787786276.206372:0:6696:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787786276.206404:0:6696:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1787786276.299376:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786277.322267:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786278.351454:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786279.369946:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786280.394984:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786280.970702:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686731776:0@lo:400: 00000100:00100000:2.0:1787786280.970778:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786280.970887:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787786280.970894:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3314:1874629686731648:0@lo:400: 00000100:00100000:2.0:1787786280.970927:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786280.970956:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874629686731904:0@lo:400: 00000100:00100000:2.0:1787786280.970979:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786280.971037:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686731776 00000100:00100000:2.0:1787786280.971043:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686731776 00000100:00100000:2.0:1787786280.971088:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686731904 00000100:00100000:2.0:1787786280.971092:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686731904 00000100:00100000:2.0:1787786280.971125:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787786280.971129:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787786280.971135:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686731776:12345-0@lo:400: 00000100:00100000:2.0:1787786280.971971:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686731776:12345-0@lo:400: Request processed in 835us (1188us total) trans 0 rc 0/0 00010000:00080000:3.0:1787786280.972004:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5237c09680 x1874629686731776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787786296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786280.972005:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787786280.972048:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787786280.972049:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686731776:0@lo:400: 00000100:00100000:2.0:1787786280.972061:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874629686731904:12345-0@lo:400: 00000100:00100000:2.0:1787786280.972123:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874629686731904:12345-0@lo:400: Request processed in 67us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786280.972129:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1787786280.972209:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5237c0a1c0 x1874629686731904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787786296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786280.972220:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874629686731904:0@lo:400: 00000100:00100000:1.0:1787786280.974721:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686731648 00000100:00100000:1.0:1787786280.974736:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686731648 00000100:00100000:1.0:1787786280.974823:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787786280.974834:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:3314:x1874629686731648:12345-0@lo:400: 00000100:00100000:1.0:1787786280.974928:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:3314:x1874629686731648:12345-0@lo:400: Request processed in 96us (3999us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786280.974936:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787786280.975132:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3314:1874629686731648:0@lo:400: 00010000:00010000:1.0:1787786281.426967:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786282.445082:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787786282.507013:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787786282.507021:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8b5207b73000 from 21 10000000:01000000:1.0:1787786282.507027:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787786282.507071:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b5201676600/0x450132973bff1f49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786282.507084:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b5201676600/0x450132973bff1f49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786282.507096:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b5201676600/0x450132973bff1f49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786282.507581:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b303c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686732032:0@lo:101: 00000100:00100000:1.0:1787786282.507652:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786282.507783:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523bb01000 going to sleep for 11 seconds 00000100:00100000:3.0:1787786282.508214:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686732032 00000100:00100000:3.0:1787786282.508223:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686732032 00000100:00100000:3.0:1787786282.508279:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787786282.508289:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:5843:x1874629686732032:12345-0@lo:101: 00010000:00010000:3.0:1787786282.508304:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786282.508319:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b52421d4c00/0x450132973bff1f50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff1f49 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786282.508347:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b52421d4c00/0x450132973bff1f50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff1f49 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786282.508358:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b52421d4c00/0x450132973bff1f50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1f49 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786282.508367:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d4c00, rc 0) 00000100:00100000:3.0:1787786282.508419:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:5843:x1874629686732032:12345-0@lo:101: Request processed in 130us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786282.508426:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787786282.508489:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b303c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686732032:0@lo:101: 00010000:00010000:0.0:1787786282.508506:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b5201676600/0x450132973bff1f49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1f50 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786282.508515:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b5201676600/0x450132973bff1f49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff1f50 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786282.508578:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205315680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686732160:0@lo:501: 00000100:00100000:0.0:1787786282.508609:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786282.508641:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52090dd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787786282.508780:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686732160 00000100:00100000:3.0:1787786282.508785:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686732160 00000100:00100000:3.0:1787786282.508830:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787786282.508837:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:5843:x1874629686732160:12345-0@lo:501: 00000100:00100000:3.0:1787786282.509725:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:5843:x1874629686732160:12345-0@lo:501: Request processed in 884us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786282.509734:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787786282.512483:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205315680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686732160:0@lo:501: 00000100:00100000:0.0:1787786282.512623:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205315680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686732288:0@lo:503: 00000100:00100000:0.0:1787786282.512706:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786282.512756:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52090dd3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787786282.513339:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686732288 00000100:00100000:2.0:1787786282.513347:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686732288 00000100:00100000:2.0:1787786282.513397:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787786282.513406:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:5843:x1874629686732288:12345-0@lo:503: 00000100:00100000:2.0:1787786282.514317:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:5843:x1874629686732288:12345-0@lo:503: Request processed in 910us (1609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786282.514328:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787786282.514417:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205315680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686732288:0@lo:503: 00000100:00100000:3.0:1787786282.515146:0:7049:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7049:1874629686732416:0@lo:502: 00000100:00100000:3.0:1787786282.515282:0:7049:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786282.515356:0:7049:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5206d47900 going to sleep for 11 seconds 00000100:00100000:2.0:1787786282.515393:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686732416 00000100:00100000:2.0:1787786282.515399:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686732416 00000100:00100000:2.0:1787786282.515474:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787786282.515484:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:7049:x1874629686732416:12345-0@lo:502: 00000100:00100000:2.0:1787786282.515821:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:7049:x1874629686732416:12345-0@lo:502: Request processed in 338us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786282.515830:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787786282.515921:0:7049:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7049:1874629686732416:0@lo:502: 00000100:00100000:3.0:1787786282.515973:0:7049:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7049:1874629686732544:0@lo:502: 00000100:00100000:3.0:1787786282.516017:0:7049:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786282.516414:0:7049:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5206d47900 going to sleep for 11 seconds 00000100:00100000:0.0:1787786282.516466:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686732544 00000100:00100000:0.0:1787786282.516471:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686732544 00000100:00100000:0.0:1787786282.516504:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787786282.516511:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:7049:x1874629686732544:12345-0@lo:502: 00000100:00100000:0.0:1787786282.516740:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:7049:x1874629686732544:12345-0@lo:502: Request processed in 229us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786282.516748:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787786282.516847:0:7049:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7049:1874629686732544:0@lo:502: 00000040:00080000:3.0:1787786282.516872:0:7049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1787786282.517308:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1787786282.517328:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787786282.517337:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b5201676600/0x450132973bff1f49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1f50 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786282.517347:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b5201676600/0x450132973bff1f49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1f50 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787786282.517357:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787786282.517360:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8b5207b73000 from 4 10000000:01000000:0.0:1787786282.517362:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787786282.517391:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b5200031a00/0x450132973bff1f57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786282.517399:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b5200031a00/0x450132973bff1f57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786282.517407:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b5200031a00/0x450132973bff1f57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786282.517423:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205315680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686732672:0@lo:101: 00000100:00100000:0.0:1787786282.517453:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786282.517476:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52090dd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787786282.517488:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686732672 00000100:00100000:0.0:1787786282.517492:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686732672 00000100:00100000:0.0:1787786282.517519:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787786282.517525:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:5843:x1874629686732672:12345-0@lo:101: 00010000:00010000:0.0:1787786282.517535:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786282.517615:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5200030600/0x450132973bff1f5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff1f57 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786282.517640:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5200030600/0x450132973bff1f5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff1f57 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786282.517649:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5200030600/0x450132973bff1f5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1f57 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786282.517657:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5200030600, rc 0) 00000100:00100000:0.0:1787786282.517685:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:5843:x1874629686732672:12345-0@lo:101: Request processed in 161us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786282.517691:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787786282.517725:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205315680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686732672:0@lo:101: 00010000:00010000:0.0:1787786282.517738:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b5200031a00/0x450132973bff1f57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1f5e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786282.517746:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b5200031a00/0x450132973bff1f57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff1f5e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786282.517939:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205315680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686732800:0@lo:256: 00000100:00100000:0.0:1787786282.517980:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786282.518010:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5210d4d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787786282.518022:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686732800 00000100:00100000:0.0:1787786282.518026:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686732800 00000100:00100000:0.0:1787786282.518043:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787786282.518384:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:5843:x1874629686732800:12345-0@lo:256: 20000000:01000000:0.0:1787786282.518401:0:5840:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787786282.518416:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787786282.518420:0:5840:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1787786282.518504:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:5843:x1874629686732800:12345-0@lo:256: Request processed in 449us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786282.518511:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787786282.518634:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205315680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686732800:0@lo:256: 10000000:01000000:2.0:1787786282.518676:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787786282.518682:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b5200031a00/0x450132973bff1f57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1f5e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786282.518691:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b5200031a00/0x450132973bff1f57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1f5e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787786282.518703:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787786282.518705:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1787786282.518708:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787786282.518728:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520151b000/0x450132973bff1f65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786282.518735:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b520151b000/0x450132973bff1f65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786282.518743:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b520151b000/0x450132973bff1f65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786282.518757:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c0a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686732928:0@lo:101: 00000100:00100000:2.0:1787786282.519054:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786282.519247:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52103efb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787786282.519289:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686732928 00000100:00100000:0.0:1787786282.519294:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686732928 00000100:00100000:0.0:1787786282.519325:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787786282.519332:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:5843:x1874629686732928:12345-0@lo:101: 00010000:00010000:0.0:1787786282.519340:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786282.519350:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5200031800/0x450132973bff1f6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff1f65 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786282.519368:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5200031800/0x450132973bff1f6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff1f65 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786282.519378:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5200031800/0x450132973bff1f6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1f65 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786282.519386:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5200031800, rc 0) 00000100:00100000:0.0:1787786282.519414:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:5843:x1874629686732928:12345-0@lo:101: Request processed in 82us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786282.519419:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787786282.519486:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c0a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686732928:0@lo:101: 00010000:00010000:2.0:1787786282.519498:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b520151b000/0x450132973bff1f65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1f6c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786282.519506:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b520151b000/0x450132973bff1f65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff1f6c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786282.519615:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c0a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686733056:0@lo:501: 00000100:00100000:2.0:1787786282.519645:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786282.519690:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52103efb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787786282.519723:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686733056 00000100:00100000:0.0:1787786282.519728:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686733056 00000100:00100000:0.0:1787786282.519808:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787786282.519816:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:5843:x1874629686733056:12345-0@lo:501: 00000100:00100000:1.0:1787786282.520197:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c0a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686733056:0@lo:501: 00000100:00100000:1.0:1787786282.520228:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b30780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686733184:0@lo:503: 00000100:00100000:0.0:1787786282.520238:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:5843:x1874629686733056:12345-0@lo:501: Request processed in 423us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786282.520245:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787786282.520279:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786282.520295:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686733184 00000100:00100000:2.0:1787786282.520299:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686733184 00000100:00100000:1.0:1787786282.520299:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523bb01900 going to sleep for 11 seconds 00000100:00100000:2.0:1787786282.520318:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787786282.520331:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:5843:x1874629686733184:12345-0@lo:503: 00000100:00100000:2.0:1787786282.520688:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:5843:x1874629686733184:12345-0@lo:503: Request processed in 356us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786282.520695:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787786282.520814:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b30780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686733184:0@lo:503: 00000100:00100000:3.0:1787786282.521325:0:7050:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7050:1874629686733312:0@lo:502: 00000100:00100000:3.0:1787786282.521366:0:7050:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786282.521426:0:7050:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5206d47a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787786282.521454:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686733312 00000100:00100000:2.0:1787786282.521459:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686733312 00000100:00100000:2.0:1787786282.521515:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787786282.521523:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:7050:x1874629686733312:12345-0@lo:502: 00000100:00100000:2.0:1787786282.521755:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:7050:x1874629686733312:12345-0@lo:502: Request processed in 232us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786282.521763:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787786282.521896:0:7050:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9d2c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7050:1874629686733312:0@lo:502: 00000020:01000000:0.0:1787786282.521934:0:7050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787786282.521943:0:7050:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1787786282.521949:0:7050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787786282.521951:0:7050:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1787786282.521956:0:7050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1787786282.521959:0:7050:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.134@tcp to nid 0x20000c0a8cc86 (192.168.204.134@tcp) 00000020:01000000:0.0:1787786282.521980:0:7050:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1787786282.521982:0:7050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787786282.522016:0:7050:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8b5209114d28) 00000020:00000080:0.0:1787786282.522035:0:7050:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1787786282.522040:0:7050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1787786282.522103:0:7050:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1787786282.522295:0:7050:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:0.0:1787786282.522303:0:7050:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x450132973bff1f7a 00010000:00080000:0.0:1787786282.522333:0:7050:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b51013a4800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.134@tcp at head 00010000:00010000:0.0:1787786282.522540:0:7050:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1787786282.572728:0:7050:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787786282.572754:0:7050:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787786282.573594:0:7050:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787786282.573823:0:7050:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787786282.573876:0:7050:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787786282.573957:0:7050:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1787786282.581468:0:7062:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787786282.581670:0:7062:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787786282.582899:0:7050:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787786282.583022:0:7050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787786282.583057:0:7050:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787786282.583083:0:7050:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x450132973bff1f81 00000100:00080000:0.0:1787786282.583094:0:7050:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787786282.583099:0:7050:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8b51013a4800 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:0.0:1787786282.583207:0:7050:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b52053152c0 x1874629686733440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787786282.583265:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52053152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874629686733440:0@lo:8: 00000100:00100000:3.0:1787786282.583335:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787786282.583402:0:7050:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787786282.583456:0:7050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787786282.583460:0:7050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787786282.583462:0:7050:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787786282.583465:0:7050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787786282.583469:0:7050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787786282.583470:0:7050:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787786282.583485:0:7050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787786282.583487:0:7050:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787786282.583511:0:7050:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52053170c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7050:1874629686733568:0@lo:502: 00000100:00100000:0.0:1787786282.583564:0:7050:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786282.583583:0:7050:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5210d4d780 going to sleep for 11 seconds 00000100:00100000:0.0:1787786282.583609:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686733440 00000100:00100000:0.0:1787786282.583615:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686733440 00000100:00100000:0.0:1787786282.583648:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787786282.583656:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221a9f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1874629686733440:12345-0@lo:8: 00010000:00080000:0.0:1787786282.583679:0:6698:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:0.0:1787786282.583835:0:6698:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x450132973bff1f88 00002000:00100000:0.0:1787786282.583866:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8b5237bf4800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113935 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787786282.583870:0:6698:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1787786282.583873:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787786282.584026:0:6698:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787786282.584248:0:6698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787786282.584278:0:6698:0:(import.c:65:import_set_state_nolock()) ffff8b5237bf5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787786282.584590:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221a9f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1874629686733440:12345-0@lo:8: Request processed in 932us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786282.584599:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787786282.584711:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686733568 00000100:00100000:0.0:1787786282.584715:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686733568 00000100:00100000:0.0:1787786282.584748:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787786282.584757:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:7050:x1874629686733568:12345-0@lo:502: 00000100:00100000:0.0:1787786282.585163:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:7050:x1874629686733568:12345-0@lo:502: Request processed in 406us (1597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786282.585171:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787786282.585213:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787786282.585226:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205315e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874629686733696:0@lo:400: 00000100:00100000:0.0:1787786282.585260:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786282.585294:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205316d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686733824:0@lo:400: 00000100:00100000:0.0:1787786282.585317:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786282.585353:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686733696 00000100:00100000:0.0:1787786282.585358:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686733696 00000100:00100000:0.0:1787786282.585381:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686733824 00000100:00100000:0.0:1787786282.585384:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686733824 00000100:00100000:0.0:1787786282.585406:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787786282.585412:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5205317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874629686733696:12345-0@lo:400: 00000100:00100000:0.0:1787786282.585448:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5205317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874629686733696:12345-0@lo:400: Request processed in 36us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786282.585454:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787786282.585467:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787786282.585602:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52053143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686733824:12345-0@lo:400: 00000100:00100000:0.0:1787786282.585639:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52053143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686733824:12345-0@lo:400: Request processed in 167us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786282.585655:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1787786282.585681:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787786282.585779:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5205316d00 x1874629686733824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787786298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786282.585813:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205316d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686733824:0@lo:400: 00010000:00080000:0.0:1787786282.585843:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5205315e00 x1874629686733696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787786298 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786282.585853:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205315e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874629686733696:0@lo:400: 00000100:00100000:0.0:1787786282.585875:0:7050:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52053170c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7050:1874629686733568:0@lo:502: 00000020:01000000:0.0:1787786282.585977:0:7050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787786282.585983:0:7050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787786282.585996:0:7050:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787786282.586000:0:7050:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1787786282.586188:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1787786282.586208:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1787786282.586217:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520151b000/0x450132973bff1f65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1f6c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786282.586229:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b520151b000/0x450132973bff1f65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1f6c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787786282.586238:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1787786282.586241:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8b52090acd28 from 1 10000000:01000000:0.0:1787786282.586244:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787786282.586281:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff1f8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786282.586297:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff1f8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786282.586307:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff1f8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786282.586322:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52053170c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686733952:0@lo:101: 00000100:00100000:0.0:1787786282.586352:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786282.586377:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5210d4d780 going to sleep for 11 seconds 00000100:00100000:0.0:1787786282.586391:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686733952 00000100:00100000:0.0:1787786282.586395:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686733952 00000100:00100000:0.0:1787786282.586419:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787786282.586425:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52063f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:5843:x1874629686733952:12345-0@lo:101: 00010000:00010000:0.0:1787786282.586434:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786282.586445:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b520912ca00/0x450132973bff1f96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff1f8f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786282.586468:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b520912ca00/0x450132973bff1f96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff1f8f expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786282.586632:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b520912ca00/0x450132973bff1f96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1f8f expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786282.586642:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912ca00, rc 0) 00000100:00100000:0.0:1787786282.586731:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52063f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:5843:x1874629686733952:12345-0@lo:101: Request processed in 306us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786282.586738:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:3.0:1787786282.587367:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b52053152c0 x1874629686733440/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787786292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786282.587380:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787786282.587390:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787786282.587397:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787786282.587403:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787786282.587414:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b51013a4800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787786282.587438:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787786282.587445:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52053152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874629686733440:0@lo:8: 00000100:00100000:1.0:1787786282.588343:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52053170c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686733952:0@lo:101: 00010000:00010000:1.0:1787786282.588364:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff1f8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1f96 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786282.588373:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff1f8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff1f96 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787786282.588406:0:7062:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787786282.588545:0:7062:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 208946753725ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787786282.594231:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c09a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686734080:0@lo:501: 00000100:00100000:2.0:1787786282.594307:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786282.594361:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52304e4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787786282.594531:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686734080 00000100:00100000:1.0:1787786282.594541:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686734080 00000100:00100000:1.0:1787786282.594591:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787786282.594600:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52063f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:5843:x1874629686734080:12345-0@lo:501: 00000100:00100000:1.0:1787786282.595016:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52063f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:5843:x1874629686734080:12345-0@lo:501: Request processed in 416us (707us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787786282.595025:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787786282.595073:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c09a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686734080:0@lo:501: 10000000:01000000:1.0:1787786282.595174:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787786282.595184:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff1f8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1f96 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786282.595195:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff1f8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1f96 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:1.0:1787786282.642663:0:7067:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg434-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787786282.707687:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686734208:0@lo:13: 00000100:00100000:1.0:1787786282.707765:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786282.708372:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686734208 00000100:00100000:3.0:1787786282.708381:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686734208 00000100:00100000:3.0:1787786282.708540:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787786282.708551:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b30780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874629686734208:12345-0@lo:13: 00002000:00000024:3.0:1787786282.708583:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000004:00080000:2.0:1787786282.708673:0:7063:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787786282.708701:0:7063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c0b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7063:1874629686734336:0@lo:7: 00000100:00100000:2.0:1787786282.708736:0:7063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786282.708757:0:7063:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5202d3f0c0 going to sleep for 11 seconds 00000100:00080000:2.0:1787786282.709006:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787786282.709108:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686734336 00000100:00100000:0.0:1787786282.709124:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686734336 00000100:00100000:0.0:1787786282.709193:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787786282.709201:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7063:x1874629686734336:12345-0@lo:7: 00000100:00100000:3.0:1787786282.711778:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b30780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874629686734208:12345-0@lo:13: Request processed in 3223us (4005us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786282.711807:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787786282.716878:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5237c08000 x1874629686734208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786298 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786282.717183:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686734208:0@lo:13: 00002000:00080000:0.0:1787786282.727612:0:6700:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1787786282.727623:0:6700:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787786282.727727:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7063:x1874629686734336:12345-0@lo:7: Request processed in 18522us (18985us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786282.727738:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787786282.728080:0:7063:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5237c0b480 x1874629686734336/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787786298 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786282.728095:0:7063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c0b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7063:1874629686734336:0@lo:7: 00000004:00080000:2.0:1787786282.728111:0:7063:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787786282.728151:0:7063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c0b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7063:1874629686734464:0@lo:5: 00000100:00100000:2.0:1787786282.728188:0:7063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786282.728246:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686734464 00000100:00100000:2.0:1787786282.728253:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686734464 00000100:00100000:2.0:1787786282.728291:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787786282.728300:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7063:x1874629686734464:12345-0@lo:5: 00002000:00080000:2.0:1787786282.728326:0:6699:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787786282.728330:0:6699:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787786282.728569:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7063:x1874629686734464:12345-0@lo:5: Request processed in 269us (379us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787786282.728576:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787786282.728618:0:7063:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5212405900 going to sleep for 11 seconds 00010000:00080000:2.0:1787786282.728634:0:7063:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5237c0b480 x1874629686734464/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787786298 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786282.728646:0:7063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c0b480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7063:1874629686734464:0@lo:5: 00000004:00080000:2.0:1787786282.728655:0:7063:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787786282.728677:0:7063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c09a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7063:1874629686734592:0@lo:700: 00000100:00100000:2.0:1787786282.728700:0:7063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786282.728729:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686734592 00000100:00100000:2.0:1787786282.728733:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686734592 00000100:00100000:2.0:1787786282.728758:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787786282.728766:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c0a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7063:x1874629686734592:12345-0@lo:700: 00000100:00100000:2.0:1787786282.728812:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c0a580 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6707:1874629686734720:0@lo:700: 00000100:00100000:2.0:1787786282.728841:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786282.728859:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5212405900 going to sleep for 11 seconds 00000100:00100000:2.0:1787786282.728893:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686734720 00000100:00100000:2.0:1787786282.728897:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686734720 00000100:00100000:2.0:1787786282.729079:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787786282.729086:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6707:x1874629686734720:12345-0@lo:700: 00000100:00100000:2.0:1787786282.729529:0:7063:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5202d3f0c0 going to sleep for 11 seconds 00000004:00080000:1.0:1787786282.761396:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:3.0:1787786282.787342:0:5853:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1787786282.793257:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6707:x1874629686734720:12345-0@lo:700: Request processed in 64163us (64407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786282.793272:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787786282.793348:0:6707:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5237c0a580 x1874629686734720/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787786298 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786282.793364:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c0a580 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6707:1874629686734720:0@lo:700: 40000000:02000000:3.0:1787786282.793379:0:6707:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:3.0:1787786282.908961:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787786282.909007:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:1.0:1787786282.909329:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c0a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7063:x1874629686734592:12345-0@lo:700: Request processed in 180558us (180622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786282.909363:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787786282.909462:0:7063:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5237c09a40 x1874629686734592/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787786298 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786282.909553:0:7063:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787786282.909572:0:7063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c09a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7063:1874629686734592:0@lo:700: 00000004:02000040:2.0:1787786282.963079:0:7063:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1787786282.972875:0:7063:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9da40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7063:1874629686734848:0@lo:5: 00000100:00100000:3.0:1787786282.972949:0:7063:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786282.973016:0:7063:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52066b0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787786282.973216:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686734848 00000100:00100000:0.0:1787786282.973224:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686734848 00000100:00100000:0.0:1787786282.973285:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787786282.973295:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7063:x1874629686734848:12345-0@lo:5: 00002000:00080000:0.0:1787786282.982948:0:6700:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1787786282.982973:0:6700:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1787786282.990554:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7063:x1874629686734848:12345-0@lo:5: Request processed in 17254us (17596us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787786282.990567:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787786282.990771:0:7063:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5221a9da40 x1874629686734848/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787786298 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786282.990812:0:7063:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9da40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7063:1874629686734848:0@lo:5: 00000004:00080000:3.0:1787786282.990828:0:7063:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1787786283.474442:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786284.491073:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786285.515638:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786286.541723:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786287.563055:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786287.628294:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686735232:0@lo:400: 00000100:00100000:3.0:1787786287.628424:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786287.628506:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787786287.628513:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686735360:0@lo:400: 00000100:00100000:3.0:1787786287.628542:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786287.628587:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686735232 00000100:00100000:3.0:1787786287.628597:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686735232 00000100:00100000:3.0:1787786287.628666:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787786287.628678:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221a9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686735232:12345-0@lo:400: 00000100:00100000:3.0:1787786287.628738:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221a9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686735232:12345-0@lo:400: Request processed in 63us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786287.628746:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787786287.628781:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686735360 00000100:00100000:3.0:1787786287.628784:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686735360 00000100:00100000:3.0:1787786287.628847:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787786287.628855:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221a9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1874629686735360:12345-0@lo:400: 00000100:00100000:3.0:1787786287.628899:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221a9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1874629686735360:12345-0@lo:400: Request processed in 33us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786287.628906:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1787786287.628923:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787786287.628928:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787786287.628965:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5221a9f0c0 x1874629686735360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786287.628981:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686735360:0@lo:400: 00010000:00080000:3.0:1787786287.628992:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5221a9ed00 x1874629686735232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787786303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786287.628999:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686735232:0@lo:400: 00000100:00100000:0.0:1787786287.629327:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686734976:0@lo:400: 00000100:00100000:0.0:1787786287.629385:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786287.629426:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787786287.629432:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874629686735104:0@lo:400: 00000100:00100000:0.0:1787786287.629458:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786287.629488:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686735104 00000100:00100000:0.0:1787786287.629492:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686735104 00000100:00100000:0.0:1787786287.629521:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787786287.629527:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5205316940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874629686735104:12345-0@lo:400: 00000100:00100000:0.0:1787786287.629575:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5205316940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874629686735104:12345-0@lo:400: Request processed in 47us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786287.629582:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787786287.629609:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5221a9cb40 x1874629686735104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787786303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786287.629620:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874629686735104:0@lo:400: 00000100:00100000:3.0:1787786287.630620:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686734976 00000100:00100000:3.0:1787786287.630633:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686734976 00000100:00100000:3.0:1787786287.630683:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787786287.630693:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:3311:x1874629686734976:12345-0@lo:400: 00000100:00100000:3.0:1787786287.630776:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:3311:x1874629686734976:12345-0@lo:400: Request processed in 84us (1390us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786287.630784:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787786287.630931:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686734976:0@lo:400: 00000001:00080000:3.0:1787786287.848602:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:2.0:1787786288.146305:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686735488:0@lo:13: 00000100:00100000:2.0:1787786288.147183:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786288.147379:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686735488 00000100:00100000:1.0:1787786288.147390:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686735488 00000100:00100000:1.0:1787786288.147449:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787786288.147460:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686735488:12345-0@lo:13: 00002000:00000024:1.0:1787786288.147509:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787786288.147565:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686735488:12345-0@lo:13: Request processed in 108us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786288.147573:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787786288.148087:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5237c09680 x1874629686735488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786288.148102:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787786288.148133:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686735488:0@lo:13: 00010000:00010000:3.0:1787786288.599941:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786289.611653:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786290.634143:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786291.664969:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786292.681889:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786292.746865:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b32d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686735744:0@lo:400: 00000100:00100000:1.0:1787786292.746974:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786292.747047:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787786292.747054:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686735872:0@lo:400: 00000100:00100000:1.0:1787786292.747099:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786292.747146:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686735744 00000100:00100000:1.0:1787786292.747155:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686735744 00000100:00100000:1.0:1787786292.747450:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686735872 00000100:00100000:1.0:1787786292.747455:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686735872 00000100:00100000:1.0:1787786292.747491:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787786292.747500:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b30f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686735744:12345-0@lo:400: 00000100:00100000:1.0:1787786292.747565:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b30f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686735744:12345-0@lo:400: Request processed in 65us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786292.747573:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787786292.747592:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787786292.747599:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b31e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686735872:12345-0@lo:400: 00000100:00100000:1.0:1787786292.747630:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b31e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686735872:12345-0@lo:400: Request processed in 31us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786292.747636:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1787786292.747657:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787786292.747687:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5221b312c0 x1874629686735872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787786308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786292.747701:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b312c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686735872:0@lo:400: 00010000:00080000:1.0:1787786292.747711:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5221b32d00 x1874629686735744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787786308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786292.747719:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b32d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686735744:0@lo:400: 00000100:00100000:3.0:1787786292.747829:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686736000:0@lo:400: 00000100:00100000:3.0:1787786292.747863:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786292.747910:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787786292.747916:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b303c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686735616:0@lo:400: 00000100:00100000:3.0:1787786292.747945:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786292.748172:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686736000 00000100:00100000:1.0:1787786292.748177:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686736000 00000100:00100000:1.0:1787786292.748364:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787786292.748375:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221a9ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686736000:12345-0@lo:400: 00000100:00100000:1.0:1787786292.748434:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221a9ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686736000:12345-0@lo:400: Request processed in 61us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786292.748441:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787786292.748471:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5221b330c0 x1874629686736000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786308 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786292.748481:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686736000:0@lo:400: 00000100:00080000:3.0:1787786292.748579:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787786292.748762:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686735616 00000100:00100000:0.0:1787786292.748768:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686735616 00000100:00100000:0.0:1787786292.748827:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787786292.748835:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:3311:x1874629686735616:12345-0@lo:400: 00000100:00100000:0.0:1787786292.749384:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:3311:x1874629686735616:12345-0@lo:400: Request processed in 41us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786292.749395:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787786292.749628:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b303c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686735616:0@lo:400: 00000100:00100000:0.0:1787786293.266731:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787786293.266759:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686736128:0@lo:13: 00000100:00100000:0.0:1787786293.266861:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786293.266994:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686736128 00000100:00100000:2.0:1787786293.267002:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686736128 00000100:00100000:2.0:1787786293.267046:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787786293.267055:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5205315e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686736128:12345-0@lo:13: 00002000:00000024:2.0:1787786293.267093:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787786293.267139:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5205315e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686736128:12345-0@lo:13: Request processed in 86us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786293.267146:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787786293.267201:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5237c08b40 x1874629686736128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786293.267221:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686736128:0@lo:13: 00010000:00010000:1.0:1787786293.708195:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787786294.716734:0:7626:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787786294.716739:0:7626:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1787786294.716924:0:7626:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8b5213768000 00000020:01000004:0.0:1787786294.716942:0:7626:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1787786294.716955:0:7626:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1787786294.716970:0:7626:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8b5209113370) 00000020:00000080:0.0:1787786294.716989:0:7626:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787786294.732418:0:7626:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787786294.732952:0:7626:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00010000:00010000:0.0:1787786294.734349:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1787786294.752741:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1787786294.772559:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787786294.772604:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1787786294.772660:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787786294.772689:0:7626:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787786294.773541:0:7626:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787786294.773557:0:7626:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787786294.773568:0:7626:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x450132973bff1fa4 00000020:01000004:0.0:1787786294.773576:0:7626:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1787786294.773598:0:7626:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.134@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787786294.773602:0:7626:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787786294.773608:0:7626:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787786294.773628:0:7626:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1787786294.773632:0:7626:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.134@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787786294.805350:0:7626:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.134@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787786294.805392:0:7626:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.134@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787786294.805396:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787786294.805398:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787786294.805400:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787786294.805401:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787786294.805402:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787786294.805403:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787786294.805404:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787786294.805406:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787786294.805407:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787786294.805409:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787786294.805411:0:7626:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787786294.805415:0:7626:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787786294.805417:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787786294.805418:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787786294.805419:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787786294.805420:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787786294.805422:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787786294.805423:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787786294.805424:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787786294.805425:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787786294.805426:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787786294.805427:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787786294.805428:0:7626:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787786294.805467:0:7626:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787786294.805487:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c09e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686736256:0@lo:253: 00000100:00100000:2.0:1787786294.805568:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786294.805618:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b521241ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1787786294.805761:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686736256 00000100:00100000:1.0:1787786294.805778:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686736256 00000100:00100000:1.0:1787786294.805861:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787786294.805869:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:7626:x1874629686736256:12345-0@lo:253: 20000000:01000000:1.0:1787786294.805901:0:5841:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787786294.805906:0:5841:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1787786294.805910:0:5841:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1787786294.805914:0:5841:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1787786294.807203:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787786294.808000:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1787786294.808019:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1787786294.808068:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1787786294.808081:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1787786294.808188:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1787786294.811669:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1787786294.813696:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1787786294.813732:0:5841:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.134@tcp 20000000:01000000:3.0:1787786294.813735:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.134@tcp (null) (null) (null) 00000040:00080000:3.0:1787786294.813965:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1787786294.813974:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787786294.814051:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1787786294.814061:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.134@tcp (null) (null) 00000040:00080000:3.0:1787786294.814096:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1787786294.814184:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787786294.814222:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1787786294.814350:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1787786294.815414:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1787786294.815437:0:5841:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.134@tcp 20000000:01000000:3.0:1787786294.815439:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.134@tcp (null) (null) (null) 00000040:00080000:3.0:1787786294.815474:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1787786294.815483:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787786294.815511:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1787786294.815519:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.134@tcp (null) (null) 00000040:00080000:3.0:1787786294.815548:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1787786294.815557:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1787786294.815601:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1787786294.815634:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1787786294.815649:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1787786294.815652:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1787786294.815658:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787786294.815659:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787786294.815661:0:5841:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787786294.815673:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787786294.815676:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787786294.815710:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787786294.815713:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787786294.816667:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1787786294.816764:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1787786294.816907:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1787786294.817380:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1787786294.817428:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1787786294.817499:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1787786294.817513:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787786294.817515:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787786294.820511:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1787786294.820604:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1787786294.820662:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1787786294.821305:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1787786294.821352:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1787786294.821487:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1787786294.821501:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787786294.821504:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787786294.822507:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1787786294.823217:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1787786294.823567:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1787786294.823661:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1787786294.823678:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787786294.823681:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787786294.824844:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1787786294.824931:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1787786294.824987:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1787786294.826627:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1787786294.826687:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1787786294.826725:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 10000000:01000000:3.0:1787786294.826760:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787786294.827172:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b52421d4a00/0x450132973bff1fab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786294.827193:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b52421d5400/0x450132973bff1efc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1ef5 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786294.827200:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b520151b400/0x450132973bff1f26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1f1f expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786294.827206:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b52421d4c00/0x450132973bff1f50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1f49 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786294.827212:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b5200031800/0x450132973bff1f6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1f65 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786294.827218:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b520912ca00/0x450132973bff1f96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1f8f expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786294.827225:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b52421d4a00/0x450132973bff1fab lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786294.827339:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b520912ca00/0x450132973bff1f96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff1f8f expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786294.827449:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b520912ca00/0x450132973bff1f96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff1f8f expref: 16 pid: 5839 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786294.827465:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9f0c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5841:1874629686736384:0@lo:104: 00000100:00100000:3.0:1787786294.827541:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787786294.827645:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b5200031800/0x450132973bff1f6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff1f65 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786294.827653:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b5200031800/0x450132973bff1f6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff1f65 expref: 16 pid: 5839 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786294.827662:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9d680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5841:1874629686736512:0@lo:104: 00010000:00010000:3.0:1787786294.827688:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b52421d4c00/0x450132973bff1f50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff1f49 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786294.827695:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b52421d4c00/0x450132973bff1f50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff1f49 expref: 16 pid: 5840 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786294.827702:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9da40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5841:1874629686736640:0@lo:104: 00010000:00010000:3.0:1787786294.827724:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b520151b400/0x450132973bff1f26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff1f1f expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786294.827732:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b520151b400/0x450132973bff1f26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff1f1f expref: 16 pid: 5841 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786294.827740:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9cf00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5841:1874629686736768:0@lo:104: 00010000:00010000:3.0:1787786294.827785:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b52421d5400/0x450132973bff1efc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff1ef5 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786294.827832:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b52421d5400/0x450132973bff1efc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff1ef5 expref: 16 pid: 5840 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786294.827840:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9cb40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5841:1874629686736896:0@lo:104: 00000100:00100000:3.0:1787786294.827863:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52304be9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787786294.828324:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787786294.828346:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786294.828495:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786294.828564:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786294.828584:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686736384 00000100:00100000:1.0:1787786294.828591:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686736384 00000100:00100000:1.0:1787786294.828627:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686736512 00000100:00100000:1.0:1787786294.828630:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686736512 00000100:00100000:1.0:1787786294.828658:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686736640 00000100:00100000:1.0:1787786294.828662:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686736640 00000100:00100000:1.0:1787786294.828674:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787786294.828687:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5207291c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+5:5841:x1874629686736384:12345-0@lo:104: 00010000:00010000:1.0:1787786294.828701:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff1f8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1f96 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786294.828877:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9f0c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5841:1874629686736384:0@lo:104: 00010000:00010000:1.0:1787786294.828927:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787786294.828933:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5207291c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+5:5841:x1874629686736384:12345-0@lo:104: Request processed in 247us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786294.828941:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787786294.828994:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787786294.829000:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+4:5841:x1874629686736512:12345-0@lo:104: 00010000:00010000:1.0:1787786294.829008:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff8b520151b000/0x450132973bff1f65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1f6c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786294.829091:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9d680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5841:1874629686736512:0@lo:104: 00000100:00100000:2.0:1787786294.829227:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786294.829246:0:5829:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1787786294.829254:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:3.0:1787786294.829588:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686736768 00000100:00100000:3.0:1787786294.829593:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686736768 00000100:00100000:3.0:1787786294.829620:0:5829:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1787786294.829625:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686736896 00000100:00100000:3.0:1787786294.829627:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686736896 00000100:00100000:2.0:1787786294.829738:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787786294.829746:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+6:5841:x1874629686736640:12345-0@lo:104: 00010000:00010000:2.0:1787786294.829767:0:7632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff8b5201676600/0x450132973bff1f49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1f50 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786294.829885:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9da40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5841:1874629686736640:0@lo:104: 00010000:00010000:0.0:1787786294.830012:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787786294.830020:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff1f8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1f96 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.830028:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912d400 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:0.0:1787786294.830031:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff1f8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff1f96 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.830050:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff1f8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff1f96 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787786294.830057:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff1f8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff1f96 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787786294.830062:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787786294.830219:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff1f8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1f96 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.830227:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787786294.830282:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52053152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686737024:0@lo:103: 00000100:00100000:3.0:1787786294.830321:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787786294.830384:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff1f8f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1f96 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.830391:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff1f8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1f96 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.830404:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787786294.830407:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b520151b000/0x450132973bff1f65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1f6c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.830412:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520151b000 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:0.0:1787786294.830415:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b520151b000/0x450132973bff1f65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff1f6c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.830421:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b520151b000/0x450132973bff1f65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff1f6c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787786294.830426:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b520151b000/0x450132973bff1f65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff1f6c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787786294.830437:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787786294.830455:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b520151b000/0x450132973bff1f65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1f6c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.830462:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787786294.830521:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787786294.830529:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+6:5841:x1874629686736512:12345-0@lo:104: Request processed in 1528us (2181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786294.830537:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787786294.830561:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787786294.830570:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c09680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+5:5841:x1874629686736768:12345-0@lo:104: 00010000:00010000:1.0:1787786294.830579:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff8b5200031c00/0x450132973bff1f1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1f26 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.830617:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787786294.830622:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c09680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+5:5841:x1874629686736768:12345-0@lo:104: Request processed in 56us (2058us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786294.830628:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787786294.830641:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787786294.830656:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+4:5841:x1874629686736896:12345-0@lo:104: 00010000:00010000:1.0:1787786294.830664:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff8b5201676a00/0x450132973bff1ef5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1efc expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.830692:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787786294.830696:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+4:5841:x1874629686736896:12345-0@lo:104: Request processed in 42us (1470us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786294.830701:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787786294.830719:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205315680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3314:1874629686737152:0@lo:103: 00000100:00100000:1.0:1787786294.830743:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787786294.830782:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1787786294.830814:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686737024 00000100:00100000:1.0:1787786294.830819:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686737024 00010000:00010000:1.0:1787786294.830837:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b520912ca00/0x450132973bff1f96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1f8f expref: 17 pid: 5839 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786294.830860:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686737152 00000100:00100000:1.0:1787786294.830863:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686737152 00010000:00010000:1.0:1787786294.830874:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b5200031800/0x450132973bff1f6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1f65 expref: 18 pid: 5839 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786294.830887:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787786294.830892:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5220164b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:3313:x1874629686737024:12345-0@lo:103: 00010000:00010000:1.0:1787786294.830904:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786294.830909:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b520912ca00/0x450132973bff1f96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1f8f expref: 18 pid: 5839 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.830919:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b520912ca00/0x450132973bff1f96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff1f8f expref: 18 pid: 5839 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.830943:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b520912ca00/0x450132973bff1f96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff1f8f expref: 18 pid: 5839 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.830956:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787786294.831064:0:7632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787786294.831072:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+3:5841:x1874629686736640:12345-0@lo:104: Request processed in 1327us (2577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786294.831079:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1787786294.831406:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b520151b000/0x450132973bff1f65 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1f6c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.831414:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b520151b000/0x450132973bff1f65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1f6c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.831426:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787786294.831429:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b5200031c00/0x450132973bff1f1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1f26 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.831435:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5200031c00 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:0.0:1787786294.831438:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b5200031c00/0x450132973bff1f1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff1f26 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.831444:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b5200031c00/0x450132973bff1f1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff1f26 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787786294.831451:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b5200031c00/0x450132973bff1f1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff1f26 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787786294.831457:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787786294.831476:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b5200031c00/0x450132973bff1f1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1f26 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.831482:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787786294.831507:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b5200031c00/0x450132973bff1f1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1f26 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.831514:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b5200031c00/0x450132973bff1f1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1f26 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.831524:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787786294.831527:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b5201676a00/0x450132973bff1ef5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1efc expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.831533:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5201676a00 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:0.0:1787786294.831536:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b5201676a00/0x450132973bff1ef5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff1efc expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.831542:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b5201676a00/0x450132973bff1ef5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff1efc expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787786294.831548:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b5201676a00/0x450132973bff1ef5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff1efc expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787786294.831553:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787786294.831568:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b5201676a00/0x450132973bff1ef5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1efc expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.831573:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787786294.831578:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b5201676a00/0x450132973bff1ef5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1efc expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.831583:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b5201676a00/0x450132973bff1ef5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1efc expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.831592:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786294.831599:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786294.831601:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786294.831615:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205314b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686737280:0@lo:103: 00000100:00100000:0.0:1787786294.831649:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786294.831676:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787786294.831681:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52053161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686737408:0@lo:103: 00000100:00100000:0.0:1787786294.831704:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786294.832482:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5220164b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:3313:x1874629686737024:12345-0@lo:103: Request processed in 1585us (2156us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786294.832493:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787786294.832515:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686737280 00000100:00100000:1.0:1787786294.832521:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686737280 00010000:00010000:1.0:1787786294.832545:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b520151b400/0x450132973bff1f26 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1f1f expref: 17 pid: 5841 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786294.832560:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686737408 00000100:00100000:1.0:1787786294.832563:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686737408 00010000:00010000:1.0:1787786294.832573:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b52421d5400/0x450132973bff1efc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1ef5 expref: 18 pid: 5840 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786294.832585:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787786294.832591:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b303c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:3314:x1874629686737152:12345-0@lo:103: 00010000:00010000:1.0:1787786294.832603:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786294.832607:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b5200031800/0x450132973bff1f6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1f65 expref: 18 pid: 5839 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.832618:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b5200031800/0x450132973bff1f6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff1f65 expref: 18 pid: 5839 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.832633:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5200031800/0x450132973bff1f6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff1f65 expref: 18 pid: 5839 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.832661:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786294.832708:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b303c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:3314:x1874629686737152:12345-0@lo:103: Request processed in 117us (1964us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786294.832715:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787786294.832729:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787786294.832735:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5205314780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:3311:x1874629686737280:12345-0@lo:103: 00010000:00010000:1.0:1787786294.832743:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786294.832747:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b520151b400/0x450132973bff1f26 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1f1f expref: 16 pid: 5841 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.832764:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b520151b400/0x450132973bff1f26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff1f1f expref: 16 pid: 5841 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.832774:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786294.832821:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5205314780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:3311:x1874629686737280:12345-0@lo:103: Request processed in 86us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786294.832827:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787786294.832839:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787786294.832846:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5205314f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:3311:x1874629686737408:12345-0@lo:103: 00010000:00010000:1.0:1787786294.832854:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786294.832857:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b52421d5400/0x450132973bff1efc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1ef5 expref: 15 pid: 5840 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.832864:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b52421d5400/0x450132973bff1efc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff1ef5 expref: 15 pid: 5840 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.832872:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786294.832900:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5205314f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:3311:x1874629686737408:12345-0@lo:103: Request processed in 55us (1195us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786294.832907:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787786294.832949:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52053161c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686737408:0@lo:103: 00000100:00100000:1.0:1787786294.832956:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205314b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686737280:0@lo:103: 00000100:00100000:0.0:1787786294.833548:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205315680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3314:1874629686737152:0@lo:103: 00000100:00100000:3.0:1787786294.833695:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52053152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686737024:0@lo:103: 00010000:00010000:3.0:1787786294.833886:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b520151b400/0x450132973bff1f26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff1f1f expref: 14 pid: 5841 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786294.833898:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9cf00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5841:1874629686736768:0@lo:104: 00010000:00010000:3.0:1787786294.833907:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b52421d5400/0x450132973bff1efc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff1ef5 expref: 13 pid: 5840 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786294.833914:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9cb40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5841:1874629686736896:0@lo:104: 00010000:00010000:3.0:1787786294.833943:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b52421d4a00/0x450132973bff1fab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786294.834215:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786294.834219:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786294.834221:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786294.834252:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b5201676600/0x450132973bff1f49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1f50 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.834260:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5201676600 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1787786294.834264:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b5201676600/0x450132973bff1f49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff1f50 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.834273:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b5201676600/0x450132973bff1f49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff1f50 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787786294.834279:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b5201676600/0x450132973bff1f49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff1f50 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787786294.834284:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787786294.834777:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b5201676600/0x450132973bff1f49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1f50 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.834787:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787786294.834846:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b5201676600/0x450132973bff1f49 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1f50 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.834853:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b5201676600/0x450132973bff1f49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1f50 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.834871:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786294.834882:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786294.834883:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786294.834945:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787786294.834964:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3314:1874629686737536:0@lo:103: 00000100:00100000:2.0:1787786294.835027:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786294.835227:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686737536 00000100:00100000:1.0:1787786294.835279:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686737536 00010000:00010000:1.0:1787786294.835385:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b52421d4c00/0x450132973bff1f50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1f49 expref: 13 pid: 5840 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786294.835424:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787786294.835433:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c09a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:3314:x1874629686737536:12345-0@lo:103: 00010000:00010000:1.0:1787786294.835446:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786294.835451:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b52421d4c00/0x450132973bff1f50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1f49 expref: 13 pid: 5840 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.835461:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b52421d4c00/0x450132973bff1f50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff1f49 expref: 13 pid: 5840 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.835477:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b52421d4c00/0x450132973bff1f50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff1f49 expref: 13 pid: 5840 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.835491:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b52421d4a00/0x450132973bff1fab lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.835500:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b52421d4a00/0x450132973bff1fab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.835515:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b52421d4a00/0x450132973bff1fab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.835523:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b52421d4a00/0x450132973bff1fab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.835530:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b52421d4a00/0x450132973bff1fab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.835543:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b52421d4a00/0x450132973bff1fab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.835549:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d4a00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:1.0:1787786294.835553:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b52421d4a00/0x450132973bff1fab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.835562:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b52421d4a00/0x450132973bff1fab lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.835583:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b52421d4a00/0x450132973bff1fab lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.835594:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786294.835641:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c09a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:3314:x1874629686737536:12345-0@lo:103: Request processed in 209us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786294.835649:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787786294.835820:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b330c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3314:1874629686737536:0@lo:103: 00010000:00010000:3.0:1787786294.835887:0:5841:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b52421d4a00/0x450132973bff1fab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786294.835897:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b52421d4a00/0x450132973bff1fab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786294.835902:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b52421d4a00/0x450132973bff1fab lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787786294.835914:0:5841:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787786294.883637:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+11:7626:x1874629686736256:12345-0@lo:253: Request processed in 77759us (78059us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786294.883653:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787786294.883778:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c09e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686736256:0@lo:253: 10000000:01000000:2.0:1787786294.883824:0:7626:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787786294.883828:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787786294.883829:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787786294.883831:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787786294.883832:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1787786294.883833:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787786294.883834:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787786294.883836:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787786294.883837:0:7626:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787786294.883838:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787786294.883839:0:7626:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787786294.883861:0:7626:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8b5213768000 from lustre-OST0001 10000000:01000000:2.0:1787786294.883888:0:7626:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1787786294.883905:0:7626:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787786294.883913:0:7626:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8b52090acd28 local copy 10000000:01000000:2.0:1787786294.883917:0:7626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787786294.883955:0:7626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520151a800/0x450132973bff1fb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786294.883966:0:7626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.134@tcp lock: ffff8b520151a800/0x450132973bff1fb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786294.883975:0:7626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b520151a800/0x450132973bff1fb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786294.883994:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c09e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686737664:0@lo:101: 00000100:00100000:2.0:1787786294.884033:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786294.884063:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52090dd540 going to sleep for 11 seconds 00000100:00100000:0.0:1787786294.884127:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686737664 00000100:00100000:0.0:1787786294.884134:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686737664 00000100:00100000:0.0:1787786294.884177:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787786294.884186:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+11:7626:x1874629686737664:12345-0@lo:101: 00010000:00010000:0.0:1787786294.884198:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786294.884212:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b520912d400/0x450132973bff1fb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff1fb2 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.884233:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b520912d400/0x450132973bff1fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff1fb2 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.884256:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b520912d400/0x450132973bff1fb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1fb2 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.884264:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912d400, rc 0) 00000100:00100000:0.0:1787786294.884300:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:7626:x1874629686737664:12345-0@lo:101: Request processed in 116us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786294.884315:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787786294.884482:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c09e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686737664:0@lo:101: 00010000:00010000:2.0:1787786294.884494:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b520151a800/0x450132973bff1fb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x450132973bff1fb9 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786294.884503:0:7626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b520151a800/0x450132973bff1fb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x450132973bff1fb9 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786294.884604:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c09e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686737792:0@lo:501: 00000100:00100000:2.0:1787786294.884633:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786294.884654:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52090dd540 going to sleep for 11 seconds 00000100:00100000:0.0:1787786294.884705:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686737792 00000100:00100000:0.0:1787786294.884709:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686737792 00000100:00100000:0.0:1787786294.884740:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787786294.884760:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:7626:x1874629686737792:12345-0@lo:501: 00000100:00100000:0.0:1787786294.884992:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:7626:x1874629686737792:12345-0@lo:501: Request processed in 244us (357us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787786294.884998:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787786294.885104:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c09e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686737792:0@lo:501: 10000000:01000000:2.0:1787786294.885117:0:7626:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787786294.885141:0:7626:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787786294.885146:0:7626:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520151a800/0x450132973bff1fb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x450132973bff1fb9 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786294.885160:0:7626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520151a800/0x450132973bff1fb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x450132973bff1fb9 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786294.885167:0:7626:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.134@tcp lock: ffff8b520151a800/0x450132973bff1fb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x450132973bff1fb9 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786294.885188:0:7626:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787786294.885207:0:7626:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8b5213768000 10000000:01000000:2.0:1787786294.885211:0:7626:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787786294.885216:0:7626:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787786294.885218:0:7626:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787786294.885222:0:7626:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787786294.885224:0:7626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787786294.885252:0:7626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520151aa00/0x450132973bff1fc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786294.885260:0:7626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b520151aa00/0x450132973bff1fc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786294.885268:0:7626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b520151aa00/0x450132973bff1fc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786294.885280:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c09e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686737920:0@lo:101: 00000100:00100000:2.0:1787786294.885305:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786294.885335:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52090dd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787786294.885389:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686737920 00000100:00100000:1.0:1787786294.885393:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686737920 00000100:00100000:1.0:1787786294.885431:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787786294.885439:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:7626:x1874629686737920:12345-0@lo:101: 00010000:00010000:1.0:1787786294.885447:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786294.885460:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5201676600/0x450132973bff1fc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff1fc0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.885479:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5201676600/0x450132973bff1fc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff1fc0 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.885488:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5201676600/0x450132973bff1fc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1fc0 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.885503:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5201676600, rc 0) 00000100:00100000:1.0:1787786294.885532:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:7626:x1874629686737920:12345-0@lo:101: Request processed in 94us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786294.885538:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787786294.885675:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c09e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686737920:0@lo:101: 00010000:00010000:2.0:1787786294.885686:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b520151aa00/0x450132973bff1fc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1fc7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786294.885706:0:7626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b520151aa00/0x450132973bff1fc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff1fc7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786294.885779:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c09e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686738048:0@lo:501: 00000100:00100000:2.0:1787786294.885839:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786294.885854:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52090dd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787786294.885903:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686738048 00000100:00100000:1.0:1787786294.885909:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686738048 00000100:00100000:1.0:1787786294.885940:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787786294.885947:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:7626:x1874629686738048:12345-0@lo:501: 00000100:00100000:1.0:1787786294.886130:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:7626:x1874629686738048:12345-0@lo:501: Request processed in 182us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786294.886136:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00010000:0.0:1787786294.886209:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787786294.886216:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b520151a800/0x450132973bff1fb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x450132973bff1fb9 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.886224:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520151a800 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:0.0:1787786294.886228:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b520151a800/0x450132973bff1fb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x450132973bff1fb9 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.886246:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b520151a800/0x450132973bff1fb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x450132973bff1fb9 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787786294.886254:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b520151a800/0x450132973bff1fb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x450132973bff1fb9 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787786294.886260:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787786294.886282:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b520151a800/0x450132973bff1fb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x450132973bff1fb9 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.886288:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787786294.886318:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b520151a800/0x450132973bff1fb2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x450132973bff1fb9 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.886336:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b520151a800/0x450132973bff1fb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x450132973bff1fb9 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.886350:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786294.886352:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786294.886353:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786294.886454:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205315680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3314:1874629686738176:0@lo:103: 00000100:00100000:1.0:1787786294.886483:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786294.886582:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c09e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686738048:0@lo:501: 00000100:00100000:2.0:1787786294.886610:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c09e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686738304:0@lo:503: 00000100:00100000:2.0:1787786294.886650:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786294.886671:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52090dd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787786294.886724:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686738304 00000100:00100000:1.0:1787786294.886728:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686738304 00000100:00100000:1.0:1787786294.886769:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787786294.886777:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:7626:x1874629686738304:12345-0@lo:503: 00000100:00100000:1.0:1787786294.886948:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:7626:x1874629686738304:12345-0@lo:503: Request processed in 172us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786294.886955:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787786294.887039:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c09e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686738304:0@lo:503: 00000040:00080000:2.0:1787786294.887325:0:7626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787786294.887395:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c09e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686738432:0@lo:502: 00000100:00100000:2.0:1787786294.887429:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786294.887463:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52090dd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787786294.887576:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686738432 00000100:00100000:1.0:1787786294.887581:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686738432 00000100:00100000:1.0:1787786294.887612:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787786294.887619:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:7626:x1874629686738432:12345-0@lo:502: 00000100:00100000:1.0:1787786294.887773:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:7626:x1874629686738432:12345-0@lo:502: Request processed in 154us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786294.887786:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787786294.887912:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686738176 00000100:00100000:0.0:1787786294.887916:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686738176 00000100:00100000:0.0:1787786294.887946:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787786294.887953:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b32d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:3314:x1874629686738176:12345-0@lo:103: 00010000:00010000:0.0:1787786294.887964:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787786294.887981:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b520912d400/0x450132973bff1fb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x450132973bff1fb2 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.887994:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787786294.888024:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b32d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:3314:x1874629686738176:12345-0@lo:103: Request processed in 72us (1539us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786294.888030:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787786294.888107:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205315680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3314:1874629686738176:0@lo:103: 00000100:00100000:2.0:1787786294.888184:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c09e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686738432:0@lo:502: 00000040:00080000:2.0:1787786294.888458:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787786294.888512:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787786294.888552:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787786294.888604:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787786294.888642:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787786294.888679:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787786294.888708:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c09e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686738560:0@lo:502: 00000100:00100000:2.0:1787786294.888760:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786294.888869:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52090dd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787786294.889094:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686738560 00000100:00100000:1.0:1787786294.889100:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686738560 00000100:00100000:1.0:1787786294.889138:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787786294.889145:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:7626:x1874629686738560:12345-0@lo:502: 00000100:00100000:1.0:1787786294.889448:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:7626:x1874629686738560:12345-0@lo:502: Request processed in 302us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786294.889456:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787786294.889528:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c09e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686738560:0@lo:502: 00000040:00080000:2.0:1787786294.889629:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787786294.889640:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1787786294.890362:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787786294.890372:0:7636:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1787786294.890379:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787786294.890382:0:7636:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1787786294.890388:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787786294.890403:0:7636:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8b5209124d28) 00000020:00000080:1.0:1787786294.890425:0:7636:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787786294.890433:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787786294.890938:0:7636:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b5213768000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1787786294.890948:0:7636:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787786294.890955:0:7636:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x450132973bff1fd5 00010000:00010000:1.0:1787786294.895935:0:7636:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1787786294.896342:0:7636:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1787786294.899909:0:7636:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787786294.900275:0:7636:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1787786294.905037:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787786294.905562:0:7636:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787786294.907046:0:7636:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787786294.907059:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787786294.907065:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787786294.907067:0:7636:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787786294.907072:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787786294.907076:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787786294.907083:0:7636:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787786294.907088:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787786294.907090:0:7636:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787786294.907145:0:7636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787786294.907148:0:7636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787786294.907150:0:7636:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787786294.907153:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1787786294.910876:0:7626:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1787786294.910917:0:7626:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787786294.910943:0:7626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520151aa00/0x450132973bff1fc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1fc7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786294.910956:0:7626:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b520151aa00/0x450132973bff1fc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1fc7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786294.910965:0:7626:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b5213768000 from 1 10000000:01000000:3.0:1787786294.910968:0:7626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787786294.911014:0:7626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff1fdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786294.911024:0:7626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff1fdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786294.911037:0:7626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff1fdc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786294.911073:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686738688:0@lo:101: 00000100:00100000:3.0:1787786294.911147:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786294.914684:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686738688 00000100:00100000:0.0:1787786294.914696:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686738688 00000100:00100000:0.0:1787786294.914763:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787786294.914773:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:7626:x1874629686738688:12345-0@lo:101: 00010000:00010000:0.0:1787786294.914812:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786294.914830:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b520912d400/0x450132973bff1fe3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff1fdc expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.914857:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b520912d400/0x450132973bff1fe3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff1fdc expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.914869:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b520912d400/0x450132973bff1fe3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1fdc expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.914878:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912d400, rc 0) 00000100:00100000:0.0:1787786294.914959:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:7626:x1874629686738688:12345-0@lo:101: Request processed in 188us (3812us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786294.914966:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787786294.915185:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5210d4d240 going to sleep for 11 seconds 00000100:00100000:3.0:1787786294.915217:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686738688:0@lo:101: 00010000:00010000:3.0:1787786294.915311:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff1fdc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1fe3 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786294.915322:0:7626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff1fdc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff1fe3 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786294.915464:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686738816:0@lo:501: 00000100:00100000:3.0:1787786294.915506:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786294.915583:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5210d4d240 going to sleep for 11 seconds 00000100:00100000:1.0:1787786294.915639:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686738816 00000100:00100000:1.0:1787786294.915645:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686738816 00000100:00100000:1.0:1787786294.915712:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787786294.915721:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:7626:x1874629686738816:12345-0@lo:501: 00000100:00100000:1.0:1787786294.916028:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:7626:x1874629686738816:12345-0@lo:501: Request processed in 308us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786294.916047:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787786294.916127:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686738816:0@lo:501: 00000100:00100000:3.0:1787786294.916162:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686738944:0@lo:503: 00000100:00100000:3.0:1787786294.916202:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786294.916482:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5210d4d240 going to sleep for 11 seconds 00000100:00100000:0.0:1787786294.916519:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686738944 00000100:00100000:0.0:1787786294.916526:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686738944 00000100:00100000:1.0:1787786294.916570:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787786294.916579:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:7626:x1874629686738944:12345-0@lo:503: 00000100:00100000:1.0:1787786294.916960:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:7626:x1874629686738944:12345-0@lo:503: Request processed in 380us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786294.916969:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787786294.917064:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686738944:0@lo:503: 00000040:00080000:3.0:1787786294.917390:0:7626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787786294.917463:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686739072:0@lo:502: 00000100:00100000:3.0:1787786294.917508:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786294.917774:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523d2b5540 going to sleep for 11 seconds 00000100:00100000:2.0:1787786294.917890:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686739072 00000100:00100000:2.0:1787786294.917896:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686739072 00000100:00100000:2.0:1787786294.917931:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787786294.917939:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:7626:x1874629686739072:12345-0@lo:502: 00000100:00100000:2.0:1787786294.918155:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:7626:x1874629686739072:12345-0@lo:502: Request processed in 215us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786294.918163:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787786294.918269:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686739072:0@lo:502: 00000040:00080000:3.0:1787786294.918522:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787786294.918579:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787786294.918607:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686739200:0@lo:502: 00000100:00100000:3.0:1787786294.918646:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786294.918679:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5210d4d240 going to sleep for 11 seconds 00000100:00100000:2.0:1787786294.918828:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686739200 00000100:00100000:2.0:1787786294.918834:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686739200 00000100:00100000:2.0:1787786294.918856:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787786294.918862:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:7626:x1874629686739200:12345-0@lo:502: 00000100:00100000:2.0:1787786294.918991:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:7626:x1874629686739200:12345-0@lo:502: Request processed in 128us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786294.918997:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787786294.919074:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686739200:0@lo:502: 00000040:00080000:3.0:1787786294.919164:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787786294.919175:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1787786294.920098:0:7640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787786294.920109:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787786294.920112:0:7640:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787786294.920118:0:7640:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b5213768000 00000020:00000080:1.0:1787786294.920121:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787786294.920140:0:7640:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787786294.920143:0:7640:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787786294.920144:0:7640:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1787786294.920147:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787786294.920360:0:7626:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787786294.920382:0:7626:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787786294.920433:0:7626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff1fdc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1fe3 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786294.920445:0:7626:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff1fdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1fe3 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786294.920487:0:7626:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787786294.920491:0:7626:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8b5213768000 10000000:01000000:3.0:1787786294.920494:0:7626:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8b5213768000 10000000:01000000:3.0:1787786294.920498:0:7626:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787786294.920504:0:7626:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8b5213768000 from 1 10000000:01000000:3.0:1787786294.920507:0:7626:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787786294.920539:0:7626:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b52421d5400/0x450132973bff1fea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786294.920547:0:7626:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b52421d5400/0x450132973bff1fea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786294.920558:0:7626:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b52421d5400/0x450132973bff1fea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786294.920593:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686739328:0@lo:101: 00000100:00100000:3.0:1787786294.920653:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786294.920691:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523d2b5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787786294.920761:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686739328 00000100:00100000:1.0:1787786294.920768:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686739328 00000100:00100000:1.0:1787786294.920838:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787786294.920848:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:7626:x1874629686739328:12345-0@lo:101: 00010000:00010000:1.0:1787786294.920859:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786294.920872:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5201676c00/0x450132973bff1ff1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff1fea expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.920893:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5201676c00/0x450132973bff1ff1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff1fea expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.920903:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5201676c00/0x450132973bff1ff1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1fea expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.920924:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5201676c00, rc 0) 00000100:00100000:1.0:1787786294.920960:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:7626:x1874629686739328:12345-0@lo:101: Request processed in 114us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786294.920967:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787786294.921054:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686739328:0@lo:101: 00010000:00010000:3.0:1787786294.921069:0:7626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b52421d5400/0x450132973bff1fea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1ff1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786294.921078:0:7626:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b52421d5400/0x450132973bff1fea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff1ff1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786294.921165:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686739456:0@lo:501: 00000100:00100000:3.0:1787786294.921191:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786294.921219:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523d2b5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787786294.921366:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686739456 00000100:00100000:0.0:1787786294.921372:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686739456 00000100:00100000:0.0:1787786294.921396:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787786294.921403:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:7626:x1874629686739456:12345-0@lo:501: 00000100:00100000:0.0:1787786294.921659:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:7626:x1874629686739456:12345-0@lo:501: Request processed in 255us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786294.921666:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787786294.921741:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686739456:0@lo:501: 00000100:00100000:3.0:1787786294.921782:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686739584:0@lo:503: 00000100:00100000:3.0:1787786294.921848:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786294.921865:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523d2b5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787786294.921932:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686739584 00000100:00100000:1.0:1787786294.921937:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686739584 00000100:00100000:1.0:1787786294.921967:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787786294.921974:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:7626:x1874629686739584:12345-0@lo:503: 00000100:00100000:1.0:1787786294.922112:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:7626:x1874629686739584:12345-0@lo:503: Request processed in 138us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786294.922120:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1787786294.922306:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686739584:0@lo:503: 00000040:00080000:3.0:1787786294.922582:0:7626:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787786294.922646:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686739712:0@lo:502: 00000100:00100000:3.0:1787786294.922684:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786294.922717:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523d2b5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787786294.922777:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686739712 00000100:00100000:1.0:1787786294.922782:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686739712 00000100:00100000:1.0:1787786294.922834:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787786294.922841:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:7626:x1874629686739712:12345-0@lo:502: 00000100:00100000:1.0:1787786294.923013:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:7626:x1874629686739712:12345-0@lo:502: Request processed in 171us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786294.923021:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787786294.923151:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686739712:0@lo:502: 00000040:00080000:3.0:1787786294.923484:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787786294.923537:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787786294.923571:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787786294.923621:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787786294.923660:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787786294.923720:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787786294.923769:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787786294.923845:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787786294.923908:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787786294.923945:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787786294.923974:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787786294.924018:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787786294.924054:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787786294.924087:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787786294.924134:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787786294.924169:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787786294.924198:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787786294.925378:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787786294.925463:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787786294.925501:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787786294.925562:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787786294.925599:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787786294.925633:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787786294.925700:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787786294.925764:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787786294.926336:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787786294.926401:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787786294.926439:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1787786294.926472:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787786294.926537:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1787786294.926571:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1787786294.926601:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1787786294.926630:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1787786294.926675:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1787786294.926722:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1787786294.926782:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1787786294.927228:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1787786294.927375:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686739840:0@lo:502: 00000100:00100000:3.0:1787786294.927459:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786294.927513:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523d2b5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787786294.927578:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686739840 00000100:00100000:1.0:1787786294.927585:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686739840 00000100:00100000:1.0:1787786294.927645:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787786294.927655:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:7626:x1874629686739840:12345-0@lo:502: 00000100:00100000:1.0:1787786294.927917:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:7626:x1874629686739840:12345-0@lo:502: Request processed in 262us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786294.927925:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787786294.928022:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686739840:0@lo:502: 00000040:00080000:3.0:1787786294.928105:0:7626:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1787786294.928116:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1787786294.929036:0:7641:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787786294.929051:0:7641:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8b5209110000) 00000020:00000080:0.0:1787786294.929072:0:7641:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1787786294.929138:0:7641:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b5213768000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787786294.929142:0:7641:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8b5213768000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787786294.929144:0:7641:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b5213768000 3 00010000:00080000:0.0:1787786294.929187:0:7641:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b523b44f000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.134@tcp at head 00010000:00010000:0.0:1787786294.935227:0:7641:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1787786294.935518:0:7641:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1787786294.935562:0:7641:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787786294.935576:0:7641:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x450132973bff1fff 00000100:00080000:0.0:1787786294.935588:0:7641:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787786294.935600:0:7641:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b523b44f000 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:0.0:1787786294.935643:0:7641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5205315680 x1874629686739968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787786294.935808:0:7641:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787786294.937001:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205315680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874629686739968:0@lo:38: 00000100:00100000:1.0:1787786294.937096:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786294.937576:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787786294.937590:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686740352:0@lo:400: 00000100:00100000:2.0:1787786294.937627:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786294.937735:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874629686740096:0@lo:400: 00000100:00100000:1.0:1787786294.937785:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786294.937822:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787786294.937829:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874629686740224:0@lo:400: 00000100:00100000:1.0:1787786294.937853:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786294.937853:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686739968 00000100:00100000:0.0:1787786294.937863:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686739968 00000100:00100000:1.0:1787786294.937887:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686740096 00000100:00100000:1.0:1787786294.937893:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686740096 00000100:00100000:0.0:1787786294.937901:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686740224 00000100:00100000:0.0:1787786294.937906:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686740224 00000100:00100000:1.0:1787786294.937928:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787786294.937941:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b33840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874629686740096:12345-0@lo:400: 00000100:00100000:0.0:1787786294.937942:0:5847:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787786294.937953:0:5847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787786294.938003:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b33840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874629686740096:12345-0@lo:400: Request processed in 66us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786294.938010:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787786294.938028:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787786294.938034:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b32940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874629686740224:12345-0@lo:400: 00000100:00100000:1.0:1787786294.938061:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b32940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874629686740224:12345-0@lo:400: Request processed in 28us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786294.938067:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787786294.938080:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787786294.938084:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1874629686739968:12345-0@lo:38: 00010000:00080000:1.0:1787786294.938107:0:5848:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:1.0:1787786294.938152:0:5848:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x450132973bff2006 00000004:00100000:1.0:1787786294.938169:0:5848:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787786294.938206:0:5848:0:(import.c:65:import_set_state_nolock()) ffff8b5206365000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787786294.938306:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686740352 00000100:00100000:3.0:1787786294.938311:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686740352 00000100:00100000:3.0:1787786294.938348:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787786294.938356:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686740352:12345-0@lo:400: 00000100:00100000:3.0:1787786294.938397:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686740352:12345-0@lo:400: Request processed in 43us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786294.938403:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787786294.938418:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787786294.938422:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787786294.938453:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5237c08f00 x1874629686740352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786294.938468:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686740352:0@lo:400: 00000100:00100000:1.0:1787786294.939093:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874629686739968:12345-0@lo:38: Request processed in 1004us (1994us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786294.939109:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787786294.939145:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5205315680 x1874629686739968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787786304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786294.939155:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787786294.939163:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1787786294.939169:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787786294.939174:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787786294.939176:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b523b44f000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787786294.939182:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205315680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874629686739968:0@lo:38: 00010000:00080000:0.0:1787786294.941398:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5237c0a580 x1874629686740224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787786310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786294.941417:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874629686740224:0@lo:400: 00010000:00080000:0.0:1787786294.941448:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5237c09e00 x1874629686740096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787786310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786294.941457:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874629686740096:0@lo:400: 00000040:00080000:2.0:1787786294.943462:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1787786294.943504:0:7642:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52053152c0 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7642:1874629686740480:0@lo:901: 00000100:00100000:0.0:1787786294.943580:0:7642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786294.943620:0:7642:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b521241e540 going to sleep for 11 seconds 00000020:01000000:1.0:1787786294.943658:0:7626:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1787786294.943688:0:7626:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787786294.943716:0:7626:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b52421d5400/0x450132973bff1fea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1ff1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.943727:0:7626:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b52421d5400/0x450132973bff1fea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1ff1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787786294.943810:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787786294.943813:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787786294.943814:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787786294.943816:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787786294.943817:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787786294.943818:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787786294.943819:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787786294.943821:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787786294.943822:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787786294.943824:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787786294.943825:0:7626:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787786294.943829:0:7626:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1787786294.943832:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787786294.943839:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787786294.943840:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787786294.943841:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787786294.943842:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787786294.943843:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787786294.943844:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787786294.943845:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787786294.943845:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787786294.943846:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787786294.943847:0:7626:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787786294.943862:0:7626:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787786294.943872:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b32580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686740608:0@lo:253: 00000100:00100000:2.0:1787786294.943878:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686740480 00000100:00100000:2.0:1787786294.943884:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686740480 00000100:00100000:1.0:1787786294.943908:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786294.943933:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787786294.943935:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523bb01e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787786294.943942:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5205314b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7642:x1874629686740480:12345-0@lo:901: 00000100:00100000:1.0:1787786294.943951:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686740608 00000100:00100000:1.0:1787786294.943954:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686740608 00000100:00100000:1.0:1787786294.943982:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787786294.943988:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:7626:x1874629686740608:12345-0@lo:253: 20000000:01000000:1.0:1787786294.944021:0:5841:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787786294.944035:0:5841:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787786294.944282:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5205314b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7642:x1874629686740480:12345-0@lo:901: Request processed in 341us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786294.944299:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787786294.944353:0:7642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b52053152c0 x1874629686740480/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787786310 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786294.944366:0:7642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52053152c0 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7642:1874629686740480:0@lo:901: 00000100:00080000:3.0:1787786294.944468:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:1.0:1787786294.984911:0:5841:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787786294.984934:0:5841:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787786294.985579:0:5862:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787786294.985586:0:5862:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787786294.985611:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b520912da00/0x450132973bff200d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.985630:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b5200030600/0x450132973bff1f5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1f57 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.985640:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b520912da00/0x450132973bff200d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.985684:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b5200030600/0x450132973bff1f5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff1f57 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786294.985699:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b5200030600/0x450132973bff1f5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff1f57 expref: 14 pid: 5840 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786294.985715:0:5862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52053161c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5862:1874629686740736:0@lo:104: 00000100:00100000:0.0:1787786294.985817:0:5862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786294.985855:0:5862:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b521241ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1787786294.986155:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686740736 00000100:00100000:1.0:1787786294.986163:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686740736 00000100:00100000:1.0:1787786294.986212:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787786294.986221:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5205316d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+3:5862:x1874629686740736:12345-0@lo:104: 00010000:00010000:1.0:1787786294.986246:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff8b5200031a00/0x450132973bff1f57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1f5e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.986302:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787786294.986307:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5205316d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+3:5862:x1874629686740736:12345-0@lo:104: Request processed in 88us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786294.986314:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787786294.986365:0:5862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52053161c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5862:1874629686740736:0@lo:104: 00010000:00010000:1.0:1787786294.986386:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b520912da00/0x450132973bff200d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786294.987580:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787786294.987591:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b5200031a00/0x450132973bff1f57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1f5e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786294.987601:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5200031a00 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:3.0:1787786294.987607:0:7633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b5200031a00/0x450132973bff1f57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff1f5e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786294.987626:0:7633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b5200031a00/0x450132973bff1f57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff1f5e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787786294.987633:0:7633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b5200031a00/0x450132973bff1f57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff1f5e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786294.987638:0:7633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787786294.987684:0:7633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b5200031a00/0x450132973bff1f57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1f5e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786294.987691:0:7633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787786294.987712:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b5200031a00/0x450132973bff1f57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1f5e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786294.987720:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b5200031a00/0x450132973bff1f57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1f5e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786294.987743:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786294.987755:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786294.987757:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786294.987766:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787786294.987785:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686740864:0@lo:103: 00000100:00100000:3.0:1787786294.987868:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786294.988101:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686740864 00000100:00100000:1.0:1787786294.988108:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686740864 00010000:00010000:1.0:1787786294.988136:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b5200030600/0x450132973bff1f5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1f57 expref: 15 pid: 5840 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786294.988172:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787786294.988181:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5207bdc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:3313:x1874629686740864:12345-0@lo:103: 00010000:00010000:1.0:1787786294.988193:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786294.988199:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b5200030600/0x450132973bff1f5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1f57 expref: 15 pid: 5840 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.988210:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b5200030600/0x450132973bff1f5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff1f57 expref: 15 pid: 5840 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.988224:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5200030600/0x450132973bff1f5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff1f57 expref: 15 pid: 5840 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.988248:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b520912da00/0x450132973bff200d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.988257:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b520912da00/0x450132973bff200d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787786294.988273:0:5831:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004414317s 00010000:00010000:1.0:1787786294.988278:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b520912da00/0x450132973bff200d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.988296:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b520912da00/0x450132973bff200d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.988303:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b520912da00/0x450132973bff200d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.988309:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b520912da00/0x450132973bff200d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.988315:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912da00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:1.0:1787786294.988319:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b520912da00/0x450132973bff200d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.988327:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b520912da00/0x450132973bff200d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.988351:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b520912da00/0x450132973bff200d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786294.988362:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786294.988403:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5207bdc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:3313:x1874629686740864:12345-0@lo:103: Request processed in 222us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786294.988409:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787786294.988476:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686740864:0@lo:103: 00010000:00010000:2.0:1787786294.988614:0:5862:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b520912da00/0x450132973bff200d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786294.988623:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b520912da00/0x450132973bff200d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786294.988629:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b520912da00/0x450132973bff200d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786294.994396:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:7626:x1874629686740608:12345-0@lo:253: Request processed in 50398us (50477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786294.994414:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787786294.994506:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b32580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:7626:1874629686740608:0@lo:253: 10000000:01000000:2.0:1787786294.994526:0:7626:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1787786294.994529:0:7626:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787786294.994531:0:7626:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787786294.994533:0:7626:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787786294.994534:0:7626:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787786294.994535:0:7626:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787786294.994536:0:7626:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787786294.994537:0:7626:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787786294.994539:0:7626:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787786294.994540:0:7626:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787786294.994541:0:7626:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787786294.994542:0:7626:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787786294.994559:0:7626:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787786295.013079:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787786295.013340:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787786295.014222:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787786295.014601:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787786295.014967:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787786295.015527:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787786295.027033:0:7626:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787786295.225474:0:7626:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1787786295.225496:0:7626:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1787786295.225531:0:7626:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787786295.225596:0:7626:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.134@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787786295.225611:0:7626:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1787786295.225640:0:7626:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1787786295.767250:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786296.782663:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786297.802049:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786298.378462:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787786298.378493:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686740992:0@lo:13: 00000100:00100000:3.0:1787786298.378582:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786298.379173:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686740992 00000100:00100000:2.0:1787786298.379186:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686740992 00000100:00080000:3.0:1787786298.379223:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787786298.379257:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787786298.379270:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221a9d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686740992:12345-0@lo:13: 00002000:00000024:2.0:1787786298.379318:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787786298.379385:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221a9d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686740992:12345-0@lo:13: Request processed in 119us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786298.379393:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787786298.379457:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5221b1c780 x1874629686740992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786314 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786298.379486:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686740992:0@lo:13: 00010000:00010000:1.0:1787786298.826069:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786299.854350:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786300.430155:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686741120:0@lo:400: 00000100:00100000:2.0:1787786300.430203:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686741504:0@lo:400: 00000100:00100000:3.0:1787786300.430281:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786300.430281:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786300.430407:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874629686741632:0@lo:400: 00000100:00100000:3.0:1787786300.430445:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786300.430516:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686741120 00000100:00100000:2.0:1787786300.430523:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686741120 00000100:00100000:2.0:1787786300.430574:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787786300.430585:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:3312:x1874629686741120:12345-0@lo:400: 00000100:00100000:3.0:1787786300.430634:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686741632 00000100:00100000:3.0:1787786300.430651:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686741632 00000100:00100000:3.0:1787786300.430693:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787786300.430775:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874629686741632:12345-0@lo:400: 00000100:00100000:3.0:1787786300.430840:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874629686741632:12345-0@lo:400: Request processed in 69us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786300.430848:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1787786300.430868:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787786300.430926:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686741504 00000100:00100000:3.0:1787786300.430930:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686741504 00000100:00100000:3.0:1787786300.430967:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787786300.430975:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686741504:12345-0@lo:400: 00000100:00100000:3.0:1787786300.431018:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686741504:12345-0@lo:400: Request processed in 43us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786300.431020:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:3312:x1874629686741120:12345-0@lo:400: Request processed in 59us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786300.431031:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787786300.431051:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787786300.431076:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5237c08b40 x1874629686741504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786300.431091:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1787786300.431092:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686741504:0@lo:400: 00000100:00100000:2.0:1787786300.431144:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686741120:0@lo:400: 00010000:00080000:2.0:1787786300.431157:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5237c09a40 x1874629686741632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787786316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786300.431167:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874629686741632:0@lo:400: 00000100:00100000:1.0:1787786300.431314:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686741248:0@lo:400: 00000100:00100000:1.0:1787786300.431352:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786300.431374:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787786300.431381:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686741376:0@lo:400: 00000100:00100000:1.0:1787786300.431402:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786300.431433:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686741248 00000100:00100000:1.0:1787786300.431438:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686741248 00000100:00100000:1.0:1787786300.431463:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686741376 00000100:00100000:1.0:1787786300.431466:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686741376 00000100:00100000:1.0:1787786300.431487:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787786300.431493:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b31a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686741248:12345-0@lo:400: 00000100:00100000:1.0:1787786300.431529:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b31a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686741248:12345-0@lo:400: Request processed in 36us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786300.431536:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787786300.431549:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787786300.431556:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b31680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686741376:12345-0@lo:400: 00000100:00100000:1.0:1787786300.431584:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b31680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686741376:12345-0@lo:400: Request processed in 28us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786300.431591:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1787786300.431613:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787786300.431660:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5221a9cb40 x1874629686741376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787786316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786300.431670:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686741376:0@lo:400: 00010000:00080000:1.0:1787786300.431689:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5221a9cf00 x1874629686741248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787786316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786300.431698:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686741248:0@lo:400: 00010000:00010000:3.0:1787786300.873963:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787786301.033098:0:7985:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg434-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787786301.897910:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786302.922329:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786303.498579:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686741760:0@lo:13: 00000100:00100000:1.0:1787786303.498673:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786303.498992:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686741760 00000100:00100000:2.0:1787786303.499000:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686741760 00000100:00100000:3.0:1787786303.499188:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787786303.499200:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b303c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686741760:12345-0@lo:13: 00002000:00000024:3.0:1787786303.499235:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787786303.499300:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b303c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686741760:12345-0@lo:13: Request processed in 102us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786303.499308:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787786303.499592:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5221b1de00 x1874629686741760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786319 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786303.499613:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686741760:0@lo:13: 00000100:00080000:1.0:1787786303.499824:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787786303.947208:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787786304.522075:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787786304.522085:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8b5206233000 from 30 10000000:01000000:0.0:1787786304.522093:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787786304.522149:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520912ce00/0x450132973bff2014 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786304.522161:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b520912ce00/0x450132973bff2014 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786304.522173:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b520912ce00/0x450132973bff2014 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786304.522200:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686741888:0@lo:101: 00000100:00100000:0.0:1787786304.522275:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786304.522316:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52103efb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787786304.522390:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686741888 00000100:00100000:2.0:1787786304.522398:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686741888 00000100:00100000:2.0:1787786304.522460:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787786304.522471:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:5843:x1874629686741888:12345-0@lo:101: 00010000:00010000:2.0:1787786304.522485:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786304.522498:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b520151b000/0x450132973bff201b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff2014 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786304.522540:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b520151b000/0x450132973bff201b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff2014 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786304.522551:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b520151b000/0x450132973bff201b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff2014 expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786304.522571:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520151b000, rc 0) 00000100:00100000:2.0:1787786304.522615:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:5843:x1874629686741888:12345-0@lo:101: Request processed in 146us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786304.522622:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787786304.523200:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686741888:0@lo:101: 00010000:00010000:0.0:1787786304.523218:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b520912ce00/0x450132973bff2014 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff201b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786304.523240:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b520912ce00/0x450132973bff2014 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff201b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786304.523315:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686742016:0@lo:501: 00000100:00100000:0.0:1787786304.523346:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786304.523377:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52103efb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787786304.523545:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686742016 00000100:00100000:1.0:1787786304.523551:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686742016 00000100:00100000:1.0:1787786304.523600:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787786304.523608:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:5843:x1874629686742016:12345-0@lo:501: 00000100:00100000:1.0:1787786304.524084:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:5843:x1874629686742016:12345-0@lo:501: Request processed in 475us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786304.524092:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787786304.524238:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686742016:0@lo:501: 00000100:00100000:0.0:1787786304.524272:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686742144:0@lo:503: 00000100:00100000:0.0:1787786304.524312:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786304.524335:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52103efb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787786304.524349:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686742144 00000100:00100000:0.0:1787786304.524353:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686742144 00000100:00100000:0.0:1787786304.524382:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787786304.524390:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:5843:x1874629686742144:12345-0@lo:503: 00000100:00100000:0.0:1787786304.524683:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:5843:x1874629686742144:12345-0@lo:503: Request processed in 294us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786304.524691:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787786304.524732:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686742144:0@lo:503: 00000100:00100000:0.0:1787786304.524972:0:8117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205317840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8117:1874629686742272:0@lo:502: 00000100:00100000:0.0:1787786304.525005:0:8117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786304.525023:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686742272 00000100:00100000:0.0:1787786304.525026:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686742272 00000100:00100000:0.0:1787786304.525045:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787786304.525051:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:8117:x1874629686742272:12345-0@lo:502: 00000100:00100000:0.0:1787786304.525260:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:8117:x1874629686742272:12345-0@lo:502: Request processed in 207us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786304.525267:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787786304.525295:0:8117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52103ef480 going to sleep for 11 seconds 00000100:00100000:0.0:1787786304.525309:0:8117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205317840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8117:1874629686742272:0@lo:502: 00000100:00100000:0.0:1787786304.525348:0:8117:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205317840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8117:1874629686742400:0@lo:502: 00000100:00100000:0.0:1787786304.525380:0:8117:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786304.525399:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686742400 00000100:00100000:0.0:1787786304.525402:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686742400 00000100:00100000:0.0:1787786304.525420:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787786304.525425:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:8117:x1874629686742400:12345-0@lo:502: 00000100:00100000:0.0:1787786304.525528:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:8117:x1874629686742400:12345-0@lo:502: Request processed in 102us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786304.525535:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787786304.525578:0:8117:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52103ef480 going to sleep for 11 seconds 00000100:00100000:0.0:1787786304.525591:0:8117:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205317840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8117:1874629686742400:0@lo:502: 00000040:00080000:0.0:1787786304.525609:0:8117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787786304.525661:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787786304.525676:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787786304.525686:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520912ce00/0x450132973bff2014 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff201b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786304.525696:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b520912ce00/0x450132973bff2014 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff201b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787786304.525705:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1787786304.525713:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1787786304.525716:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1787786304.525738:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520912c000/0x450132973bff2022 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786304.525746:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b520912c000/0x450132973bff2022 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786304.525754:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b520912c000/0x450132973bff2022 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786304.525766:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686742528:0@lo:101: 00000100:00100000:0.0:1787786304.525814:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786304.525828:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b4460c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787786304.525839:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686742528 00000100:00100000:0.0:1787786304.525842:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686742528 00000100:00100000:0.0:1787786304.525863:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787786304.525869:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:5843:x1874629686742528:12345-0@lo:101: 00010000:00010000:0.0:1787786304.525878:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786304.525889:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b520912c600/0x450132973bff2029 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff2022 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786304.525908:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b520912c600/0x450132973bff2029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff2022 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786304.525917:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b520912c600/0x450132973bff2029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff2022 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786304.525925:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912c600, rc 0) 00000100:00100000:0.0:1787786304.525951:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:5843:x1874629686742528:12345-0@lo:101: Request processed in 82us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786304.525962:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787786304.525994:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686742528:0@lo:101: 00010000:00010000:0.0:1787786304.526006:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b520912c000/0x450132973bff2022 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2029 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786304.526014:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b520912c000/0x450132973bff2022 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff2029 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786304.526051:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686742656:0@lo:501: 00000100:00100000:0.0:1787786304.526075:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786304.526088:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52103ef180 going to sleep for 11 seconds 00000100:00100000:0.0:1787786304.526099:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686742656 00000100:00100000:0.0:1787786304.526102:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686742656 00000100:00100000:0.0:1787786304.526121:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787786304.526128:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:5843:x1874629686742656:12345-0@lo:501: 00000100:00100000:0.0:1787786304.526328:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:5843:x1874629686742656:12345-0@lo:501: Request processed in 199us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786304.526335:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787786304.526364:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686742656:0@lo:501: 00000100:00100000:0.0:1787786304.526387:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686742784:0@lo:503: 00000100:00100000:0.0:1787786304.526424:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786304.526437:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52103ef180 going to sleep for 11 seconds 00000100:00100000:0.0:1787786304.526448:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686742784 00000100:00100000:0.0:1787786304.526452:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686742784 00000100:00100000:0.0:1787786304.526471:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787786304.526476:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:5843:x1874629686742784:12345-0@lo:503: 00000100:00100000:0.0:1787786304.526756:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:5843:x1874629686742784:12345-0@lo:503: Request processed in 278us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786304.526763:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787786304.526822:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686742784:0@lo:503: 00000100:00100000:2.0:1787786304.536216:0:8118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b1f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8118:1874629686742912:0@lo:502: 00000100:00100000:2.0:1787786304.536307:0:8118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786304.536353:0:8118:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523d2b5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787786304.536534:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686742912 00000100:00100000:0.0:1787786304.536541:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686742912 00000100:00100000:0.0:1787786304.536592:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787786304.536601:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:8118:x1874629686742912:12345-0@lo:502: 00000100:00100000:0.0:1787786304.537228:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:8118:x1874629686742912:12345-0@lo:502: Request processed in 625us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786304.537237:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787786304.537593:0:8118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b1f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8118:1874629686742912:0@lo:502: 00000020:01000000:2.0:1787786304.537626:0:8118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787786304.537635:0:8118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786304.537638:0:8118:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787786304.537642:0:8118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787786304.537645:0:8118:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787786304.537668:0:8118:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b1f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8118:1874629686743040:0@lo:502: 00000100:00100000:2.0:1787786304.537709:0:8118:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786304.537747:0:8118:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523d2b5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787786304.538607:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686743040 00000100:00100000:3.0:1787786304.538616:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686743040 00000100:00100000:3.0:1787786304.538655:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787786304.538664:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:8118:x1874629686743040:12345-0@lo:502: 00000100:00100000:3.0:1787786304.539028:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:8118:x1874629686743040:12345-0@lo:502: Request processed in 364us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786304.539036:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787786304.539160:0:8118:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b1f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8118:1874629686743040:0@lo:502: 00000020:01000000:2.0:1787786304.539188:0:8118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787786304.539193:0:8118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786304.539196:0:8118:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787786304.539200:0:8118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1787786304.539439:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787786304.539518:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787786304.539529:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520912c000/0x450132973bff2022 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2029 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786304.539540:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b520912c000/0x450132973bff2022 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2029 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787786304.539550:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787786304.539553:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8b5207b73000 from 30 10000000:01000000:0.0:1787786304.539556:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787786304.539593:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff2030 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786304.539602:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff2030 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786304.539622:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff2030 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786304.539639:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686743168:0@lo:101: 00000100:00100000:0.0:1787786304.539673:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786304.539700:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52089d9840 going to sleep for 11 seconds 00000100:00100000:0.0:1787786304.539714:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686743168 00000100:00100000:0.0:1787786304.539718:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686743168 00000100:00100000:0.0:1787786304.539744:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787786304.539751:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:5843:x1874629686743168:12345-0@lo:101: 00010000:00010000:0.0:1787786304.539761:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786304.539773:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b520912da00/0x450132973bff2037 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff2030 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786304.540527:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b520912da00/0x450132973bff2037 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff2030 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786304.540542:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b520912da00/0x450132973bff2037 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff2030 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786304.540550:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912da00, rc 0) 00000100:00100000:0.0:1787786304.540778:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:5843:x1874629686743168:12345-0@lo:101: Request processed in 1025us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786304.540786:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1787786304.541128:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205317840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686743168:0@lo:101: 00010000:00010000:2.0:1787786304.541145:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff2030 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2037 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786304.541156:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff2030 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff2037 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786304.541217:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b1f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686743296:0@lo:501: 00000100:00100000:2.0:1787786304.541249:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786304.541280:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523d2b5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787786304.541323:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686743296 00000100:00100000:3.0:1787786304.541330:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686743296 00000100:00100000:3.0:1787786304.541369:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787786304.541378:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:5843:x1874629686743296:12345-0@lo:501: 00000100:00100000:3.0:1787786304.542076:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:5843:x1874629686743296:12345-0@lo:501: Request processed in 697us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786304.542085:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787786304.542601:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b1f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686743296:0@lo:501: 00000100:00100000:0.0:1787786304.542643:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205317c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686743424:0@lo:503: 00000100:00100000:0.0:1787786304.542694:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786304.542728:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52103ef180 going to sleep for 11 seconds 00000100:00100000:2.0:1787786304.542895:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686743424 00000100:00100000:2.0:1787786304.542901:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686743424 00000100:00100000:2.0:1787786304.542936:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1787786304.542944:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:5843:x1874629686743424:12345-0@lo:503: 00000100:00100000:2.0:1787786304.543105:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:5843:x1874629686743424:12345-0@lo:503: Request processed in 161us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786304.543112:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787786304.543195:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205317c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686743424:0@lo:503: 00000100:00100000:0.0:1787786304.548193:0:8120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205317c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8120:1874629686743552:0@lo:502: 00000100:00100000:0.0:1787786304.548295:0:8120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786304.548377:0:8120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52103ef180 going to sleep for 11 seconds 00000100:00100000:2.0:1787786304.550224:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686743552 00000100:00100000:2.0:1787786304.550238:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686743552 00000100:00100000:2.0:1787786304.550306:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787786304.550316:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:8120:x1874629686743552:12345-0@lo:502: 00000100:00100000:2.0:1787786304.550634:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:8120:x1874629686743552:12345-0@lo:502: Request processed in 319us (2338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786304.550643:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787786304.551042:0:8120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205317c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8120:1874629686743552:0@lo:502: 00000100:00100000:1.0:1787786304.551104:0:8120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b32580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8120:1874629686743680:0@lo:502: 00000100:00100000:1.0:1787786304.551146:0:8120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786304.551179:0:8120:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5225de9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787786304.551241:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686743680 00000100:00100000:0.0:1787786304.551246:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686743680 00000100:00100000:0.0:1787786304.551285:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787786304.551295:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:8120:x1874629686743680:12345-0@lo:502: 00000100:00100000:0.0:1787786304.551443:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:8120:x1874629686743680:12345-0@lo:502: Request processed in 149us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786304.551461:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787786304.551866:0:8120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b32580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8120:1874629686743680:0@lo:502: 00000040:00080000:1.0:1787786304.551889:0:8120:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787786304.552124:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787786304.552141:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787786304.552152:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff2030 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2037 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786304.552171:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff2030 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2037 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787786304.552182:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787786304.552185:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8b5207b73000 from 5 10000000:01000000:2.0:1787786304.552188:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787786304.552216:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520151ae00/0x450132973bff203e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786304.552224:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b520151ae00/0x450132973bff203e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786304.552232:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b520151ae00/0x450132973bff203e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786304.552248:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b1cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686743808:0@lo:101: 00000100:00100000:2.0:1787786304.552283:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786304.552312:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523d2b5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787786304.554309:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686743808 00000100:00100000:3.0:1787786304.554323:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686743808 00000100:00100000:3.0:1787786304.554380:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787786304.554391:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:5843:x1874629686743808:12345-0@lo:101: 00010000:00010000:3.0:1787786304.554407:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786304.554425:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b52421d5a00/0x450132973bff2045 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff203e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786304.554471:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b52421d5a00/0x450132973bff2045 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff203e expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786304.554482:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b52421d5a00/0x450132973bff2045 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff203e expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786304.554491:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d5a00, rc 0) 00000100:00100000:3.0:1787786304.554559:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:5843:x1874629686743808:12345-0@lo:101: Request processed in 171us (2275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786304.554575:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787786304.554782:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b1cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686743808:0@lo:101: 00010000:00010000:1.0:1787786304.555090:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b520151ae00/0x450132973bff203e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2045 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786304.555112:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b520151ae00/0x450132973bff203e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff2045 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786304.555178:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b32580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686743936:0@lo:256: 00000100:00100000:1.0:1787786304.555218:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786304.555289:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5225de9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787786304.557744:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686743936 00000100:00100000:2.0:1787786304.557757:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686743936 00000100:00100000:1.0:1787786304.560882:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787786304.560901:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:5843:x1874629686743936:12345-0@lo:256: 20000000:01000000:1.0:1787786304.560928:0:5839:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787786304.560946:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787786304.560948:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1787786304.561087:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:5843:x1874629686743936:12345-0@lo:256: Request processed in 191us (5867us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786304.561096:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787786304.561202:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b32580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686743936:0@lo:256: 10000000:01000000:2.0:1787786304.561258:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787786304.561268:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520151ae00/0x450132973bff203e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2045 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786304.561281:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b520151ae00/0x450132973bff203e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2045 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787786304.561301:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787786304.561305:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1787786304.561308:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787786304.561340:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520151a200/0x450132973bff204c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786304.561349:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b520151a200/0x450132973bff204c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786304.561359:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b520151a200/0x450132973bff204c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786304.561380:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b1c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686744064:0@lo:101: 00000100:00100000:2.0:1787786304.561418:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786304.561767:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523d2b5540 going to sleep for 11 seconds 00000100:00100000:3.0:1787786304.561970:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686744064 00000100:00100000:3.0:1787786304.561977:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686744064 00000100:00100000:3.0:1787786304.562010:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787786304.562019:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:5843:x1874629686744064:12345-0@lo:101: 00010000:00010000:3.0:1787786304.562031:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786304.562044:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b52421d4400/0x450132973bff2053 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff204c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786304.562069:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b52421d4400/0x450132973bff2053 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff204c expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786304.562080:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b52421d4400/0x450132973bff2053 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff204c expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786304.562089:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d4400, rc 0) 00000100:00100000:3.0:1787786304.562129:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:5843:x1874629686744064:12345-0@lo:101: Request processed in 111us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786304.562136:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787786304.562250:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b1c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686744064:0@lo:101: 00010000:00010000:2.0:1787786304.562266:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b520151a200/0x450132973bff204c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2053 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786304.562276:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b520151a200/0x450132973bff204c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff2053 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786304.562338:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b1c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686744192:0@lo:501: 00000100:00100000:2.0:1787786304.562366:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786304.562384:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523d2b5540 going to sleep for 11 seconds 00000100:00100000:3.0:1787786304.562432:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686744192 00000100:00100000:3.0:1787786304.562437:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686744192 00000100:00100000:3.0:1787786304.562469:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1787786304.562475:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:5843:x1874629686744192:12345-0@lo:501: 00000100:00100000:3.0:1787786304.562952:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:5843:x1874629686744192:12345-0@lo:501: Request processed in 476us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786304.562959:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787786304.563121:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b1c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686744192:0@lo:501: 00000100:00100000:2.0:1787786304.563154:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b1c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686744320:0@lo:503: 00000100:00100000:2.0:1787786304.563205:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786304.563228:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523d2b5540 going to sleep for 11 seconds 00000100:00100000:3.0:1787786304.563282:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686744320 00000100:00100000:3.0:1787786304.563286:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686744320 00000100:00100000:3.0:1787786304.563307:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787786304.563313:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:5843:x1874629686744320:12345-0@lo:503: 00000100:00100000:3.0:1787786304.563759:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:5843:x1874629686744320:12345-0@lo:503: Request processed in 444us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786304.563766:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787786304.564852:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b1c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686744320:0@lo:503: 00000100:00100000:1.0:1787786304.566492:0:8122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b330c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8122:1874629686744448:0@lo:502: 00000100:00100000:1.0:1787786304.566577:0:8122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786304.566619:0:8122:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5225de96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787786304.567057:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686744448 00000100:00100000:0.0:1787786304.567067:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686744448 00000100:00100000:0.0:1787786304.567122:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787786304.567132:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:8122:x1874629686744448:12345-0@lo:502: 00000100:00100000:0.0:1787786304.567638:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:8122:x1874629686744448:12345-0@lo:502: Request processed in 506us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786304.567646:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787786304.567943:0:8122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b330c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8122:1874629686744448:0@lo:502: 00000020:01000000:2.0:1787786304.567979:0:8122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787786304.567989:0:8122:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787786304.567997:0:8122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786304.568000:0:8122:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787786304.568005:0:8122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787786304.568009:0:8122:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.134@tcp to nid 0x20000c0a8cc86 (192.168.204.134@tcp) 00000020:01000000:2.0:1787786304.568034:0:8122:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787786304.568037:0:8122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787786304.568063:0:8122:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8b5237ba4d28) 00000020:00000080:2.0:1787786304.568087:0:8122:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1787786304.568094:0:8122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787786304.568166:0:8122:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787786304.568173:0:8122:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787786304.568180:0:8122:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x450132973bff2061 00010000:00080000:2.0:1787786304.568210:0:8122:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b5237c5f800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.134@tcp at head 00010000:00010000:2.0:1787786304.568441:0:8122:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1787786304.569323:0:8122:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787786304.569341:0:8122:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787786304.572512:0:8122:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787786304.573125:0:8122:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787786304.573182:0:8122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787786304.573245:0:8122:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1787786304.580112:0:8123:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787786304.580123:0:8123:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1787786304.583547:0:8122:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787786304.583574:0:8122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787786304.583611:0:8122:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1787786304.583634:0:8122:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x450132973bff2068 00000100:00080000:3.0:1787786304.583645:0:8122:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787786304.583651:0:8122:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8b5237c5f800 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:3.0:1787786304.583688:0:8122:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5237c08b40 x1874629686744576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787786304.583745:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874629686744576:0@lo:8: 00000100:00100000:1.0:1787786304.583863:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786304.584022:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686744576 00000100:00100000:0.0:1787786304.584029:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686744576 00000100:00100000:0.0:1787786304.584063:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787786304.584070:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3310:x1874629686744576:12345-0@lo:8: 00010000:00080000:0.0:1787786304.584095:0:6700:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:0.0:1787786304.584128:0:6700:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x450132973bff206f 00002000:00100000:0.0:1787786304.584142:0:6700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8b523b44a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113935 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787786304.584147:0:6700:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1787786304.584150:0:6700:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787786304.584282:0:6700:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787786304.584424:0:6700:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787786304.584460:0:6700:0:(import.c:65:import_set_state_nolock()) ffff8b523b44f800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1787786304.584544:0:8122:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1787786304.584613:0:8122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787786304.584616:0:8122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787786304.584618:0:8122:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1787786304.584621:0:8122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787786304.584625:0:8122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787786304.584632:0:8122:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787786304.584635:0:8122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787786304.584637:0:8122:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787786304.584662:0:8122:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c0a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8122:1874629686744704:0@lo:502: 00000100:00100000:3.0:1787786304.584706:0:8122:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786304.584728:0:8122:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5213404b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787786304.584955:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787786304.584966:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc98f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686745088:0@lo:400: 00000100:00100000:3.0:1787786304.584974:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686744704 00000100:00100000:3.0:1787786304.584978:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686744704 00000100:00100000:2.0:1787786304.584996:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786304.585009:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787786304.585015:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:8122:x1874629686744704:12345-0@lo:502: 00000100:00100000:2.0:1787786304.585022:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc98b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874629686744960:0@lo:400: 00000100:00100000:2.0:1787786304.585116:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786304.585148:0:6699:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787786304.585155:0:6699:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787786304.585226:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:8122:x1874629686744704:12345-0@lo:502: Request processed in 209us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786304.585234:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787786304.585272:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686744832:0@lo:400: 00000100:00100000:3.0:1787786304.585297:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786304.585316:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787786304.585322:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc9a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874629686745216:0@lo:400: 00000100:00100000:3.0:1787786304.585342:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786304.585384:0:8122:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c0a580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8122:1874629686744704:0@lo:502: 00000020:01000000:3.0:1787786304.585411:0:8122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787786304.585415:0:8122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787786304.585417:0:8122:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787786304.585421:0:8122:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1787786304.585624:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1787786304.585644:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787786304.585653:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520151a200/0x450132973bff204c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2053 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786304.585664:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b520151a200/0x450132973bff204c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2053 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786304.585680:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787786304.585683:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8b52090acd28 from 1 10000000:01000000:3.0:1787786304.585686:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787786304.585709:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff2076 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786304.585717:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff2076 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786304.585725:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff2076 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786304.585738:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc9b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686745344:0@lo:101: 00000100:00100000:3.0:1787786304.585766:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786304.585881:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5206328240 going to sleep for 11 seconds 00000100:00100000:3.0:1787786304.585897:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686745344 00000100:00100000:3.0:1787786304.585901:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686745344 00000100:00100000:3.0:1787786304.585928:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787786304.585935:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:5843:x1874629686745344:12345-0@lo:101: 00010000:00010000:3.0:1787786304.585945:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786304.585958:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b52421d4e00/0x450132973bff207d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff2076 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786304.585980:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b52421d4e00/0x450132973bff207d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff2076 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786304.585991:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b52421d4e00/0x450132973bff207d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff2076 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786304.586009:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d4e00, rc 0) 00000100:00100000:3.0:1787786304.586039:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:5843:x1874629686745344:12345-0@lo:101: Request processed in 103us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786304.586045:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1787786304.586075:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc9b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686745344:0@lo:101: 00010000:00010000:3.0:1787786304.586087:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff2076 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff207d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786304.586096:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff2076 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff207d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786304.586139:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc9b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686745472:0@lo:501: 00000100:00100000:3.0:1787786304.586164:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786304.586176:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5206328240 going to sleep for 11 seconds 00000100:00100000:3.0:1787786304.586189:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686745472 00000100:00100000:3.0:1787786304.586192:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686745472 00000100:00100000:3.0:1787786304.586210:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787786304.586215:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:5843:x1874629686745472:12345-0@lo:501: 00000100:00100000:3.0:1787786304.586429:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:5843:x1874629686745472:12345-0@lo:501: Request processed in 212us (264us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787786304.586436:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787786304.586593:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc9b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686745472:0@lo:501: 10000000:01000000:3.0:1787786304.586613:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787786304.586619:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff2076 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff207d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786304.586638:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff2076 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff207d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786304.586723:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1874629686744576:12345-0@lo:8: Request processed in 2650us (2857us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786304.586731:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787786304.586744:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686745088 00000100:00100000:0.0:1787786304.586748:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686745088 00000100:00100000:0.0:1787786304.586785:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787786304.586878:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686745088:12345-0@lo:400: 00000100:00100000:0.0:1787786304.586926:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686745088:12345-0@lo:400: Request processed in 51us (1929us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786304.586931:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787786304.587130:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bc98f00 x1874629686745088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786304.587143:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc98f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686745088:0@lo:400: 00010000:00080000:1.0:1787786304.588179:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5237c08b40 x1874629686744576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787786314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786304.588191:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787786304.588200:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787786304.588209:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787786304.588214:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1787786304.588224:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b5237c5f800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787786304.588241:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787786304.588247:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874629686744576:0@lo:8: 00000100:00100000:1.0:1787786304.588281:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686744960 00000100:00100000:1.0:1787786304.588286:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686744960 00000004:00080000:2.0:1787786304.588631:0:8123:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787786304.588762:0:8123:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 230946970369ns, next at 0ns, rc = 0 00000100:00100000:2.0:1787786304.588829:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686744832 00000100:00100000:2.0:1787786304.588834:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686744832 00000100:00100000:2.0:1787786304.588867:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686745216 00000100:00100000:2.0:1787786304.588870:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686745216 00000100:00100000:2.0:1787786304.588889:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787786304.588897:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686744832:12345-0@lo:400: 00000100:00100000:2.0:1787786304.588973:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc99680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686744832:12345-0@lo:400: Request processed in 77us (3675us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786304.588980:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787786304.588996:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787786304.589002:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874629686745216:12345-0@lo:400: 00000100:00100000:2.0:1787786304.589033:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc9a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874629686745216:12345-0@lo:400: Request processed in 32us (3690us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786304.589039:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1787786304.589156:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bc9a580 x1874629686745216/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787786320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786304.589168:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc9a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874629686745216:0@lo:400: 00010000:00080000:3.0:1787786304.589181:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5237c09a40 x1874629686744832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787786320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786304.589190:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686744832:0@lo:400: 00000100:00100000:1.0:1787786304.589258:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787786304.589266:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874629686744960:12345-0@lo:400: 00000100:00100000:1.0:1787786304.589390:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874629686744960:12345-0@lo:400: Request processed in 125us (4340us total) trans 0 rc 0/0 00010000:00080000:3.0:1787786304.589392:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bc98b40 x1874629686744960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787786320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786304.589397:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787786304.589402:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc98b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874629686744960:0@lo:400: 00000100:00080000:1.0:1787786304.589417:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1787786304.621773:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1787786304.716212:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b32580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686745600:0@lo:13: 00000100:00100000:3.0:1787786304.716288:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1787786304.716365:0:8125:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787786304.716391:0:8125:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b30000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8125:1874629686745728:0@lo:7: 00000100:00100000:1.0:1787786304.716423:0:8125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786304.716458:0:8125:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52103a4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787786304.716495:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686745600 00000100:00100000:2.0:1787786304.716502:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686745600 00000100:00100000:2.0:1787786304.716613:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787786304.716623:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc98b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874629686745600:12345-0@lo:13: 00002000:00000024:2.0:1787786304.716742:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1787786304.716817:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc98b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874629686745600:12345-0@lo:13: Request processed in 195us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786304.716825:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1787786304.716880:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787786304.716927:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5221b32580 x1874629686745600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786320 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786304.716947:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b32580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686745600:0@lo:13: 00000100:00100000:1.0:1787786304.717868:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686745728 00000100:00100000:1.0:1787786304.717876:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686745728 00000100:00100000:1.0:1787786304.717929:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787786304.717939:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b32d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8125:x1874629686745728:12345-0@lo:7: 00002000:00080000:1.0:1787786304.724594:0:6700:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1787786304.724603:0:6700:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787786304.724701:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b32d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8125:x1874629686745728:12345-0@lo:7: Request processed in 6759us (8272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786304.724722:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787786304.725174:0:8125:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5221b30000 x1874629686745728/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787786320 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786304.725192:0:8125:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b30000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8125:1874629686745728:0@lo:7: 00000004:00080000:0.0:1787786304.725207:0:8125:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1787786304.725248:0:8125:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205317840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8125:1874629686745856:0@lo:5: 00000100:00100000:0.0:1787786304.725288:0:8125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786304.725341:0:8125:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5101130900 going to sleep for 11 seconds 00000100:00100000:2.0:1787786304.725507:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686745856 00000100:00100000:2.0:1787786304.725513:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686745856 00000100:00100000:2.0:1787786304.725572:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787786304.725582:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52053170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8125:x1874629686745856:12345-0@lo:5: 00002000:00080000:2.0:1787786304.725608:0:6699:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787786304.725612:0:6699:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787786304.725914:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52053170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8125:x1874629686745856:12345-0@lo:5: Request processed in 333us (625us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787786304.725921:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787786304.726102:0:8125:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5205317840 x1874629686745856/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787786320 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786304.726132:0:8125:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205317840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8125:1874629686745856:0@lo:5: 00000004:00080000:1.0:1787786304.726142:0:8125:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787786304.726173:0:8125:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b30000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8125:1874629686745984:0@lo:700: 00000100:00100000:1.0:1787786304.726198:0:8125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786304.726225:0:8125:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52103a49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787786304.726276:0:6707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686745984 00000100:00100000:0.0:1787786304.726281:0:6707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686745984 00000100:00100000:0.0:1787786304.726315:0:6707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787786304.726323:0:6707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b32580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8125:x1874629686745984:12345-0@lo:700: 00000100:00100000:0.0:1787786304.726351:0:6707:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205314780 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6707:1874629686746112:0@lo:700: 00000100:00100000:0.0:1787786304.726379:0:6707:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786304.726405:0:6707:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b51011306c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787786304.726454:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686746112 00000100:00100000:1.0:1787786304.726459:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686746112 00000100:00100000:1.0:1787786304.726499:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787786304.726506:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5205314f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6707:x1874629686746112:12345-0@lo:700: 40000000:02000000:1.0:1787786304.772125:0:5853:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1787786304.780864:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5205314f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6707:x1874629686746112:12345-0@lo:700: Request processed in 54338us (54463us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786304.780880:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787786304.783633:0:6707:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5205314780 x1874629686746112/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787786320 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786304.783653:0:6707:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205314780 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6707:1874629686746112:0@lo:700: 40000000:02000000:0.0:1787786304.783669:0:6707:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:2.0:1787786304.863708:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1787786304.863743:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:1.0:1787786304.863934:0:6707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b32580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8125:x1874629686745984:12345-0@lo:700: Request processed in 137605us (137728us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786304.863947:0:6707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787786304.864012:0:8125:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5221b30000 x1874629686745984/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787786320 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786304.864024:0:8125:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787786304.864054:0:8125:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b30000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8125:1874629686745984:0@lo:700: 00000004:02000040:0.0:1787786304.902306:0:8125:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1787786304.910450:0:8125:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205314780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8125:1874629686746240:0@lo:5: 00000100:00100000:0.0:1787786304.910525:0:8125:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786304.910632:0:8125:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5101130a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787786304.913910:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686746240 00000100:00100000:3.0:1787786304.913924:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686746240 00000100:00100000:2.0:1787786304.914154:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787786304.914166:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52053161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8125:x1874629686746240:12345-0@lo:5: 00002000:00080000:2.0:1787786304.925528:0:6698:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1787786304.925552:0:6698:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1787786304.929266:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52053161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8125:x1874629686746240:12345-0@lo:5: Request processed in 15092us (18731us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787786304.929280:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787786304.929601:0:8125:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5205314780 x1874629686746240/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787786320 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786304.929621:0:8125:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205314780 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8125:1874629686746240:0@lo:5: 00000004:00080000:0.0:1787786304.929637:0:8125:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1787786304.973075:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787786305.847999:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1787786306.001569:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786306.348458:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786306.349075:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667848320 00000100:00100000:1.0:1787786306.349087:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667848320 00000100:00100000:1.0:1787786306.349143:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 112 00000100:00100000:1.0:1787786306.349152:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2361:x1874629667848320:12345-192.168.204.34@tcp:250: 00010000:00080000:1.0:1787786306.349189:0:5840:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 23c8a9a2-8e74-48e9-afab-5150ec6daf69@192.168.204.34@tcp t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:1.0:1787786306.349220:0:5840:0:(genops.c:1385:class_connect()) connect: client 23c8a9a2-8e74-48e9-afab-5150ec6daf69, cookie 0x450132973bff2084 00000100:00080000:1.0:1787786306.349376:0:5840:0:(import.c:65:import_set_state_nolock()) ffff8b5237bb8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787786306.349467:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+5:2361:x1874629667848320:12345-192.168.204.34@tcp:250: Request processed in 314us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786306.349477:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 112 00000100:00100000:1.0:1787786306.358775:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786306.358836:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667848448 00000100:00100000:1.0:1787786306.358846:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667848448 00000100:00100000:1.0:1787786306.358900:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 113 00000100:00100000:1.0:1787786306.358910:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+5:5606:x1874629667848448:12345-192.168.204.34@tcp:101: 00010000:00010000:1.0:1787786306.358928:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786306.358944:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5201676000/0x450132973bff208b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7520ca expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786306.358972:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5201676000/0x450132973bff208b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7520ca expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786306.358984:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5201676000/0x450132973bff208b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7520ca expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786306.358993:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5201676000, rc 0) 00000100:00100000:1.0:1787786306.359068:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+6:5606:x1874629667848448:12345-192.168.204.34@tcp:101: Request processed in 159us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786306.359076:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 113 00000100:00100000:1.0:1787786306.363753:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786306.363844:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667848576 00000100:00100000:0.0:1787786306.363854:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667848576 00000100:00100000:0.0:1787786306.363913:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 114 00000100:00100000:0.0:1787786306.363923:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+6:5606:x1874629667848576:12345-192.168.204.34@tcp:501: 00000100:00100000:0.0:1787786306.364337:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+6:5606:x1874629667848576:12345-192.168.204.34@tcp:501: Request processed in 414us (593us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787786306.364346:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 114 00000100:00100000:1.0:1787786306.372417:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786306.372516:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667848704 00000100:00100000:3.0:1787786306.372540:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667848704 00000100:00100000:3.0:1787786306.372601:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 115 00000100:00100000:3.0:1787786306.372611:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+6:5606:x1874629667848704:12345-192.168.204.34@tcp:101: 00010000:00010000:3.0:1787786306.372643:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786306.372661:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b52421d5600/0x450132973bff2092 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7520d1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786306.372690:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b52421d5600/0x450132973bff2092 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7520d1 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786306.372701:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b52421d5600/0x450132973bff2092 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7520d1 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786306.372710:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d5600, rc 0) 00000100:00100000:3.0:1787786306.372771:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+7:5606:x1874629667848704:12345-192.168.204.34@tcp:101: Request processed in 162us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786306.372779:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 115 00000100:00100000:2.0:1787786306.374380:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786306.374463:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667848832 00000100:00100000:3.0:1787786306.374472:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667848832 00000100:00100000:3.0:1787786306.374518:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 116 00000100:00100000:3.0:1787786306.374539:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+7:5606:x1874629667848832:12345-192.168.204.34@tcp:501: 00000100:00100000:3.0:1787786306.374835:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+8:5606:x1874629667848832:12345-192.168.204.34@tcp:501: Request processed in 308us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786306.374843:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 116 00000100:00100000:3.0:1787786306.377033:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786306.377117:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667848960 00000100:00100000:0.0:1787786306.377127:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667848960 00000100:00100000:0.0:1787786306.377178:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 117 00000100:00100000:0.0:1787786306.377187:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+8:5606:x1874629667848960:12345-192.168.204.34@tcp:503: 00000100:00100000:0.0:1787786306.377575:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+8:5606:x1874629667848960:12345-192.168.204.34@tcp:503: Request processed in 388us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786306.377583:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 117 00000100:00100000:0.0:1787786306.383218:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786306.383308:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667849088 00000100:00100000:2.0:1787786306.383321:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667849088 00000100:00100000:2.0:1787786306.383417:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 118 00000100:00100000:2.0:1787786306.383429:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+8:5624:x1874629667849088:12345-192.168.204.34@tcp:502: 00000100:00100000:2.0:1787786306.383866:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+8:5624:x1874629667849088:12345-192.168.204.34@tcp:502: Request processed in 437us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786306.383875:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 118 00000100:00100000:3.0:1787786306.422972:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786306.423106:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667849216 00000100:00100000:1.0:1787786306.423116:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667849216 00000100:00100000:1.0:1787786306.423177:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 119 00000100:00100000:1.0:1787786306.423186:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+8:5624:x1874629667849216:12345-192.168.204.34@tcp:502: 00000100:00100000:1.0:1787786306.423550:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+8:5624:x1874629667849216:12345-192.168.204.34@tcp:502: Request processed in 363us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786306.423559:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 119 00000100:00100000:2.0:1787786306.427671:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786306.427832:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667849344 00000100:00100000:3.0:1787786306.427852:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667849344 00000100:00100000:3.0:1787786306.427944:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 120 00000100:00100000:3.0:1787786306.427970:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+8:5606:x1874629667849344:12345-192.168.204.34@tcp:101: 00010000:00010000:3.0:1787786306.428018:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786306.428044:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b52421d4600/0x450132973bff2099 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7520fb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786306.428085:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b52421d4600/0x450132973bff2099 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7520fb expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786306.428099:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b52421d4600/0x450132973bff2099 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7520fb expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786306.428111:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d4600, rc 0) 00000100:00100000:3.0:1787786306.428196:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+9:5606:x1874629667849344:12345-192.168.204.34@tcp:101: Request processed in 230us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786306.428205:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 120 00000100:00100000:3.0:1787786306.433451:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786306.433986:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667849472 00000100:00100000:0.0:1787786306.434002:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667849472 00000100:00100000:0.0:1787786306.434151:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 121 00000100:00100000:0.0:1787786306.434166:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+9:5606:x1874629667849472:12345-192.168.204.34@tcp:256: 20000000:01000000:0.0:1787786306.434206:0:5841:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787786306.434247:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787786306.434253:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787786306.434256:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787786306.434259:0:5841:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787786306.441881:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+9:5606:x1874629667849472:12345-192.168.204.34@tcp:256: Request processed in 7706us (8434us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786306.441898:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 121 00000100:00100000:1.0:1787786306.450468:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786306.450735:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667849600 00000100:00100000:3.0:1787786306.450746:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667849600 00000100:00100000:3.0:1787786306.450821:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 122 00000100:00100000:3.0:1787786306.450833:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+9:5606:x1874629667849600:12345-192.168.204.34@tcp:101: 00010000:00010000:3.0:1787786306.450857:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786306.450879:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b52421d5800/0x450132973bff20a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752102 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786306.450918:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b52421d5800/0x450132973bff20a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752102 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786306.450951:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b52421d5800/0x450132973bff20a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752102 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786306.450962:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d5800, rc 0) 00000100:00100000:3.0:1787786306.451038:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:5606:x1874629667849600:12345-192.168.204.34@tcp:101: Request processed in 207us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786306.451044:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 122 00000100:00100000:2.0:1787786306.455493:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786306.455983:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667849728 00000100:00100000:3.0:1787786306.455993:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667849728 00000100:00100000:3.0:1787786306.456052:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 123 00000100:00100000:3.0:1787786306.456062:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:5606:x1874629667849728:12345-192.168.204.34@tcp:501: 00000100:00100000:3.0:1787786306.456291:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:5606:x1874629667849728:12345-192.168.204.34@tcp:501: Request processed in 229us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786306.456298:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 123 00000100:00100000:3.0:1787786306.460133:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786306.460585:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667849856 00000100:00100000:2.0:1787786306.460596:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667849856 00000100:00100000:2.0:1787786306.460756:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 124 00000100:00100000:2.0:1787786306.460767:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:5606:x1874629667849856:12345-192.168.204.34@tcp:503: 00000100:00100000:2.0:1787786306.461168:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:5606:x1874629667849856:12345-192.168.204.34@tcp:503: Request processed in 402us (1044us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786306.461176:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 124 00000100:00100000:3.0:1787786306.465243:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786306.465426:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667849984 00000100:00100000:2.0:1787786306.465437:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667849984 00000100:00100000:2.0:1787786306.465487:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 125 00000100:00100000:2.0:1787786306.465497:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:5629:x1874629667849984:12345-192.168.204.34@tcp:502: 00000100:00100000:2.0:1787786306.466073:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:5629:x1874629667849984:12345-192.168.204.34@tcp:502: Request processed in 574us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786306.466083:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 125 00000100:00100000:3.0:1787786306.471405:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786306.471487:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667850112 00000100:00100000:1.0:1787786306.471498:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667850112 00000100:00100000:1.0:1787786306.471569:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 126 00000100:00100000:1.0:1787786306.471579:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:5629:x1874629667850112:12345-192.168.204.34@tcp:502: 00000100:00100000:1.0:1787786306.471861:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:5629:x1874629667850112:12345-192.168.204.34@tcp:502: Request processed in 282us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786306.471870:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 126 00000100:00100000:0.0:1787786306.476394:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786306.476947:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667850240 00000100:00100000:2.0:1787786306.476957:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667850240 00000100:00100000:2.0:1787786306.477046:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 4 00000100:00100000:2.0:1787786306.477055:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5205315680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2361:x1874629667850240:12345-192.168.204.34@tcp:38: 00010000:00080000:2.0:1787786306.477085:0:5847:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 173d08e0-0e54-474e-858e-1679cd38cf14@192.168.204.34@tcp t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:2.0:1787786306.477128:0:5847:0:(genops.c:1385:class_connect()) connect: client 173d08e0-0e54-474e-858e-1679cd38cf14, cookie 0x450132973bff20a7 00000004:00100000:2.0:1787786306.477154:0:5847:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787786306.477161:0:5847:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1787786306.513217:0:5847:0:(import.c:65:import_set_state_nolock()) ffff8b5237c5a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787786306.513312:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5205315680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+6:2361:x1874629667850240:12345-192.168.204.34@tcp:38: Request processed in 36255us (36926us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786306.513323:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 4 00010000:00010000:0.0:1787786307.021099:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786307.522182:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786307.522313:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667850368 00000100:00100000:1.0:1787786307.522323:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667850368 00000100:00100000:1.0:1787786307.522471:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 5 00000100:00100000:1.0:1787786307.522482:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52053152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+6:0:x1874629667850368:12345-192.168.204.34@tcp:41: 00000004:00000024:1.0:1787786307.522537:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787786307.522614:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52053152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+6:0:x1874629667850368:12345-192.168.204.34@tcp:41: Request processed in 134us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786307.522622:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 5 00000100:00080000:2.0:1787786307.523162:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787786307.523390:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786307.523530:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667850496 00000100:00100000:1.0:1787786307.523537:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667850496 00000100:00100000:1.0:1787786307.523582:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 6 00000100:00100000:1.0:1787786307.523591:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5205317c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+6:5606:x1874629667850496:12345-192.168.204.34@tcp:41: 00000004:00000024:1.0:1787786307.523612:0:5848:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787786307.523659:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5205317c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+6:5606:x1874629667850496:12345-192.168.204.34@tcp:41: Request processed in 70us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786307.523680:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 6 00000100:00100000:0.0:1787786307.526193:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786307.526318:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667850624 00000100:00100000:1.0:1787786307.526328:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667850624 00000100:00100000:1.0:1787786307.526437:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:1.0:1787786307.526448:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5205317840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+6:5606:x1874629667850624:12345-192.168.204.34@tcp:40: 00000100:00100000:1.0:1787786307.526552:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5205317840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+6:5606:x1874629667850624:12345-192.168.204.34@tcp:40: Request processed in 105us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786307.526560:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:0.0:1787786307.531375:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786307.531433:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786307.531461:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786307.531642:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667851008 00000100:00100000:3.0:1787786307.531653:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667851008 00000100:00100000:3.0:1787786307.531719:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 0 00000100:00100000:3.0:1787786307.531731:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+6:5606:x1874629667851008:12345-192.168.204.34@tcp:33: 00000100:00100000:1.0:1787786307.534823:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667850752 00000100:00100000:1.0:1787786307.534840:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667850752 00000100:00100000:1.0:1787786307.534879:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667850880 00000100:00100000:1.0:1787786307.534883:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667850880 00000100:00100000:1.0:1787786307.534912:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00100000:1.0:1787786307.534921:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf86d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2361:x1874629667850752:12345-192.168.204.34@tcp:8: 00010000:00080000:1.0:1787786307.534966:0:8126:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 173d08e0-0e54-474e-858e-1679cd38cf14@192.168.204.34@tcp t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:1.0:1787786307.535006:0:8126:0:(genops.c:1385:class_connect()) connect: client 173d08e0-0e54-474e-858e-1679cd38cf14, cookie 0x450132973bff20ae 00002000:00100000:1.0:1787786307.535019:0:8126:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 173d08e0-0e54-474e-858e-1679cd38cf14/ffff8b5237bbd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113935 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787786307.535047:0:8126:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787786307.535406:0:8126:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:0.0:1787786307.535618:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 9 00000100:00100000:0.0:1787786307.535625:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2361:x1874629667850880:12345-192.168.204.34@tcp:8: 00010000:00080000:0.0:1787786307.535654:0:6700:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 173d08e0-0e54-474e-858e-1679cd38cf14@192.168.204.34@tcp t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:0.0:1787786307.535673:0:6700:0:(genops.c:1385:class_connect()) connect: client 173d08e0-0e54-474e-858e-1679cd38cf14, cookie 0x450132973bff20b5 00002000:00100000:0.0:1787786307.535678:0:6700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 173d08e0-0e54-474e-858e-1679cd38cf14/ffff8b523b448000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113935 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787786307.535705:0:6700:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787786307.535944:0:6700:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787786307.536341:0:6700:0:(import.c:65:import_set_state_nolock()) ffff8b523b44c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787786307.536417:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:173d08e0-0e54-474e-858e-1679cd38cf14+6:2361:x1874629667850880:12345-192.168.204.34@tcp:8: Request processed in 789us (4982us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786307.538042:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 9 00000100:00080000:1.0:1787786307.538154:0:8126:0:(import.c:65:import_set_state_nolock()) ffff8b5237bbc800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787786307.538225:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf86d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+6:2361:x1874629667850752:12345-192.168.204.34@tcp:8: Request processed in 3304us (6858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786307.538232:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00100000:0.0:1787786307.545175:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786307.547574:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667851136 00000100:00100000:1.0:1787786307.547663:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667851136 00000100:00100000:1.0:1787786307.547873:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 127 00000100:00100000:1.0:1787786307.547885:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:2363:x1874629667851136:12345-192.168.204.34@tcp:400: 00000100:00100000:1.0:1787786307.547981:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:2363:x1874629667851136:12345-192.168.204.34@tcp:400: Request processed in 98us (2817us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786307.547998:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 127 00000004:00080000:0.0:1787786307.562533:0:5849:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 30708us 00000004:00200000:0.0:1787786307.581470:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787786307.582152:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+6:5606:x1874629667851008:12345-192.168.204.34@tcp:33: Request processed in 50417us (50683us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786307.582166:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 0 00000100:00100000:0.0:1787786307.802975:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786307.805868:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667851264 00000100:00100000:1.0:1787786307.805883:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667851264 00000100:00100000:1.0:1787786307.805960:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00100000:1.0:1787786307.805970:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+6:5646:x1874629667851264:12345-192.168.204.34@tcp:101: 00010000:00010000:1.0:1787786307.805990:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786307.806015:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201677c00/0x450132973bff20bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75212c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786307.806083:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201677400/0x450132973bff20c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786307.806097:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201677400/0x450132973bff20c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786307.806116:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201677400/0x450132973bff20c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787786307.806342:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787786307.806347:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787786307.806554:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201677400/0x450132973bff20c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786307.806582:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201677c00/0x450132973bff20bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75212c expref: 8 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786307.806614:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201677400/0x450132973bff20c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75212c expref: 7 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786307.806623:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b52100f1d00) 00010000:00010000:1.0:1787786307.806626:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787786307.806639:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5201677400, rc 0) 00000100:00100000:1.0:1787786307.806714:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+7:5646:x1874629667851264:12345-192.168.204.34@tcp:101: Request processed in 745us (3749us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786307.806721:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 8 00010000:00010000:3.0:1787786308.042019:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786308.619409:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787786308.619434:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686746368:0@lo:13: 00000100:00100000:2.0:1787786308.619526:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786308.619597:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686746368 00000100:00100000:2.0:1787786308.619605:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686746368 00000100:00100000:2.0:1787786308.619659:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787786308.619670:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b1c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686746368:12345-0@lo:13: 00002000:00000024:2.0:1787786308.619690:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787786308.619750:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b1c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686746368:12345-0@lo:13: Request processed in 82us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786308.619757:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1787786308.619821:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5221b1de00 x1874629686746368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786324 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786308.619838:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686746368:0@lo:13: 00000100:00080000:2.0:1787786308.619865:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787786309.066036:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786309.643203:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc9b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686746624:0@lo:400: 00000100:00100000:3.0:1787786309.643290:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786309.643360:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686747136:0@lo:400: 00000100:00100000:3.0:1787786309.643405:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786309.643440:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787786309.643447:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc9bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686746752:0@lo:400: 00000100:00100000:3.0:1787786309.643481:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786309.643515:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686746624 00000100:00100000:3.0:1787786309.643523:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686746624 00000100:00100000:3.0:1787786309.643575:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686746752 00000100:00100000:3.0:1787786309.643578:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686746752 00000100:00100000:3.0:1787786309.643609:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787786309.643619:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686746624:12345-0@lo:400: 00000100:00100000:3.0:1787786309.643672:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686746624:12345-0@lo:400: Request processed in 54us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786309.643679:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787786309.643697:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787786309.643703:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686746752:12345-0@lo:400: 00000100:00100000:3.0:1787786309.643730:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc99e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686746752:12345-0@lo:400: Request processed in 28us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786309.643736:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787786309.643753:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686747136 00000100:00100000:3.0:1787786309.643756:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686747136 00000100:00100000:3.0:1787786309.643780:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787786309.643786:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686747136:12345-0@lo:400: 00000100:00100000:3.0:1787786309.643860:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686747136:12345-0@lo:400: Request processed in 74us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786309.643867:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787786309.643906:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc9bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686746752:0@lo:400: 00000100:00100000:3.0:1787786309.643917:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc9b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686746624:0@lo:400: 00010000:00080000:3.0:1787786309.643940:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bc98000 x1874629686747136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786309.643950:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1787786309.643965:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686747136:0@lo:400: 00000100:00100000:1.0:1787786309.644318:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686746880:0@lo:400: 00000100:00100000:1.0:1787786309.644356:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786309.644388:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787786309.644395:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc9a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686746496:0@lo:400: 00000100:00100000:1.0:1787786309.644423:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786309.644446:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc99a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874629686747008:0@lo:400: 00000100:00100000:1.0:1787786309.644481:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786309.644506:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686747008 00000100:00100000:1.0:1787786309.644510:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686747008 00000100:00100000:1.0:1787786309.644534:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787786309.644540:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5220164b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874629686747008:12345-0@lo:400: 00000100:00100000:1.0:1787786309.644573:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5220164b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874629686747008:12345-0@lo:400: Request processed in 33us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786309.644579:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787786309.644605:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc99a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874629686747008:0@lo:400: 00000100:00100000:0.0:1787786309.644681:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686746880 00000100:00100000:0.0:1787786309.644684:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686746880 00000100:00100000:0.0:1787786309.644717:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787786309.644724:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686746880:12345-0@lo:400: 00000100:00100000:0.0:1787786309.644762:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686746880:12345-0@lo:400: Request processed in 39us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786309.644768:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1787786309.644819:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bc9a940 x1874629686746880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786309.644861:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc9a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686746880:0@lo:400: 00000100:00080000:2.0:1787786309.645075:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787786309.645081:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787786309.645209:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686746496 00000100:00100000:3.0:1787786309.645214:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686746496 00000100:00100000:3.0:1787786309.645291:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787786309.645298:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52063f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3311:x1874629686746496:12345-0@lo:400: 00000100:00100000:3.0:1787786309.645347:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52063f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3311:x1874629686746496:12345-0@lo:400: Request processed in 51us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786309.645353:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787786309.650041:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc9a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686746496:0@lo:400: 00000001:00100000:3.0:1787786309.685531:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 173d08e0-0e54-474e-858e-1679cd38cf14 00000100:00100000:1.0:1787786309.919842:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786309.919939:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667851392 00000100:00100000:3.0:1787786309.919951:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667851392 00000100:00100000:3.0:1787786309.920032:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 9 00000100:00100000:3.0:1787786309.920043:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+7:5699:x1874629667851392:12345-192.168.204.34@tcp:41: 00000004:00000024:3.0:1787786309.920093:0:7644:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787786309.920179:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+7:5699:x1874629667851392:12345-192.168.204.34@tcp:41: Request processed in 138us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786309.920188:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 9 00000100:00080000:2.0:1787786309.921557:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787786309.925586:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786309.925683:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667851520 00000100:00100000:2.0:1787786309.925693:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667851520 00000100:00100000:2.0:1787786309.925778:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:2.0:1787786309.925835:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf84f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:173d08e0-0e54-474e-858e-1679cd38cf14+5:5699:x1874629667851520:12345-192.168.204.34@tcp:13: 00002000:00000024:2.0:1787786309.925876:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787786309.925939:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf84f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:173d08e0-0e54-474e-858e-1679cd38cf14+5:5699:x1874629667851520:12345-192.168.204.34@tcp:13: Request processed in 152us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786309.925947:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00080000:0.0:1787786309.926151:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787786309.929114:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786309.930439:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667851648 00000100:00100000:2.0:1787786309.930455:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667851648 00000100:00100000:2.0:1787786309.930556:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00100000:2.0:1787786309.930567:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:173d08e0-0e54-474e-858e-1679cd38cf14+6:5699:x1874629667851648:12345-192.168.204.34@tcp:13: 00002000:00000024:2.0:1787786309.930611:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787786309.930703:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf86580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:173d08e0-0e54-474e-858e-1679cd38cf14+6:5699:x1874629667851648:12345-192.168.204.34@tcp:13: Request processed in 138us (1599us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786309.930712:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00080000:0.0:1787786309.930973:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787786310.090079:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786310.156732:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bf85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686747264:0@lo:13: 00000100:00100000:2.0:1787786310.156829:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786310.157130:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686747264 00000100:00100000:3.0:1787786310.157140:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686747264 00000100:00100000:3.0:1787786310.157200:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787786310.157210:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b1de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686747264:12345-0@lo:13: 00002000:00000024:3.0:1787786310.157232:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787786310.157291:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b1de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686747264:12345-0@lo:13: Request processed in 83us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786310.157313:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1787786310.157409:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bf85680 x1874629686747264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786326 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786310.157427:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bf85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686747264:0@lo:13: 00010000:00010000:3.0:1787786311.115332:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787786311.755124:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 173d08e0-0e54-474e-858e-1679cd38cf14 00000001:00100000:0.0:1787786311.760978:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 173d08e0-0e54-474e-858e-1679cd38cf14 00010000:00010000:0.0:1787786312.145739:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787786312.591363:0:8297:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1787786312.648757:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786312.648832:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786312.648868:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786312.648896:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786312.648933:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667851904 00000100:00100000:1.0:1787786312.648945:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667851904 00000100:00100000:1.0:1787786312.649023:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 22 00000100:00100000:1.0:1787786312.649037:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+6:2365:x1874629667851904:12345-192.168.204.34@tcp:400: 00000100:00100000:1.0:1787786312.649125:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+6:2365:x1874629667851904:12345-192.168.204.34@tcp:400: Request processed in 92us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786312.649133:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 22 00000100:00100000:1.0:1787786312.649165:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667852032 00000100:00100000:1.0:1787786312.649168:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667852032 00000100:00100000:1.0:1787786312.649200:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667852160 00000100:00100000:1.0:1787786312.649203:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667852160 00000100:00100000:1.0:1787786312.649223:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:1.0:1787786312.649230:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:173d08e0-0e54-474e-858e-1679cd38cf14+5:2365:x1874629667852032:12345-192.168.204.34@tcp:400: 00000100:00100000:1.0:1787786312.649257:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:173d08e0-0e54-474e-858e-1679cd38cf14+5:2365:x1874629667852032:12345-192.168.204.34@tcp:400: Request processed in 28us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786312.649263:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:0.0:1787786312.649397:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00100000:0.0:1787786312.649421:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+5:2365:x1874629667852160:12345-192.168.204.34@tcp:400: 00000100:00100000:0.0:1787786312.649453:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+5:2365:x1874629667852160:12345-192.168.204.34@tcp:400: Request processed in 49us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786312.649460:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00080000:1.0:1787786312.649516:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787786312.649522:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787786312.649525:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787786312.649926:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667851776 00000100:00100000:3.0:1787786312.649934:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667851776 00000100:00100000:3.0:1787786312.649975:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 129 00000100:00100000:3.0:1787786312.649982:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52063f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:2365:x1874629667851776:12345-192.168.204.34@tcp:400: 00000100:00100000:3.0:1787786312.650019:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52063f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:2365:x1874629667851776:12345-192.168.204.34@tcp:400: Request processed in 38us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786312.650025:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 129 00010000:00010000:0.0:1787786313.162075:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786313.747018:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bf861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686747392:0@lo:13: 00000100:00100000:2.0:1787786313.747122:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786313.747223:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686747392 00000100:00100000:2.0:1787786313.747234:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686747392 00000100:00100000:2.0:1787786313.747308:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787786313.747319:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686747392:12345-0@lo:13: 00002000:00000024:2.0:1787786313.747397:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787786313.747454:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686747392:12345-0@lo:13: Request processed in 137us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786313.747463:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1787786313.747495:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787786313.747534:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bf861c0 x1874629686747392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786313.747559:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bf861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686747392:0@lo:13: 00010000:00010000:3.0:1787786314.186330:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786314.762207:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bf85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686747904:0@lo:400: 00000100:00100000:0.0:1787786314.762300:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786314.762631:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bf87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686747520:0@lo:400: 00000100:00100000:3.0:1787786314.762673:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786314.762881:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bf87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686747648:0@lo:400: 00000100:00100000:2.0:1787786314.762918:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786314.763015:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bf86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874629686747776:0@lo:400: 00000100:00100000:0.0:1787786314.763049:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786314.763089:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686747904 00000100:00100000:0.0:1787786314.763098:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686747904 00000100:00100000:0.0:1787786314.763161:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787786314.763172:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686747904:12345-0@lo:400: 00000100:00100000:0.0:1787786314.763263:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686747904:12345-0@lo:400: Request processed in 92us (962us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786314.763272:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787786314.763313:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686747648 00000100:00100000:0.0:1787786314.763317:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686747648 00000100:00100000:0.0:1787786314.763343:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686747776 00000100:00100000:0.0:1787786314.763346:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686747776 00000100:00100000:0.0:1787786314.763391:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787786314.763398:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686747648:12345-0@lo:400: 00000100:00100000:0.0:1787786314.763433:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686747648:12345-0@lo:400: Request processed in 36us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786314.763439:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787786314.763464:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787786314.763471:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874629686747776:12345-0@lo:400: 00000100:00100000:0.0:1787786314.763505:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874629686747776:12345-0@lo:400: Request processed in 35us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786314.763511:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1787786314.763547:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787786314.763589:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bf86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874629686747776:0@lo:400: 00010000:00080000:0.0:1787786314.763631:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bf85a40 x1874629686747904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786314.763644:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bf85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686747904:0@lo:400: 00000100:00100000:1.0:1787786314.765383:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686747520 00000100:00100000:1.0:1787786314.765401:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686747520 00000100:00100000:1.0:1787786314.765492:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787786314.765504:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3312:x1874629686747520:12345-0@lo:400: 00000100:00100000:1.0:1787786314.765896:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3312:x1874629686747520:12345-0@lo:400: Request processed in 393us (3220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786314.765905:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787786314.772678:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bf87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686747520:0@lo:400: 00000100:00100000:3.0:1787786314.772855:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bf84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874629686748032:0@lo:400: 00000100:00100000:3.0:1787786314.772947:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786314.773395:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686748032 00000100:00100000:1.0:1787786314.773405:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686748032 00000100:00100000:1.0:1787786314.773514:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787786314.773538:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874629686748032:12345-0@lo:400: 00000100:00100000:1.0:1787786314.773618:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc992c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874629686748032:12345-0@lo:400: Request processed in 94us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786314.773627:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1787786314.774521:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787786314.774694:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bf84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874629686748032:0@lo:400: 00000100:00100000:2.0:1787786314.775803:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bf87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686747648:0@lo:400: 00000100:00100000:2.0:1787786314.775850:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bf87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686748160:0@lo:400: 00000100:00100000:2.0:1787786314.775936:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786314.776561:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686748160 00000100:00100000:1.0:1787786314.776573:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686748160 00000100:00100000:1.0:1787786314.776667:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1787786314.776672:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787786314.776679:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221a9da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686748160:12345-0@lo:400: 00000100:00100000:1.0:1787786314.776771:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221a9da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686748160:12345-0@lo:400: Request processed in 95us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786314.776780:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1787786314.776831:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bf87480 x1874629686748160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786314.776845:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bf87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686748160:0@lo:400: 00010000:00010000:0.0:1787786315.211373:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786315.275978:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bf86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686748288:0@lo:13: 00000100:00100000:2.0:1787786315.276091:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786315.276613:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686748288 00000100:00100000:0.0:1787786315.276624:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686748288 00000100:00100000:0.0:1787786315.276695:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787786315.276706:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221a9cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686748288:12345-0@lo:13: 00002000:00000024:0.0:1787786315.276776:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787786315.276877:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221a9cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686748288:12345-0@lo:13: Request processed in 172us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786315.276885:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1787786315.277654:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bf86940 x1874629686748288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786331 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786315.277686:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bf86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686748288:0@lo:13: 00010000:00010000:0.0:1787786316.238836:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787786316.527736:0:8446:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffecd076b00 20000000:00000080:3.0:1787786316.527770:0:8446:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8b52329b9c00 uarg=0000000000000000 20000000:01000000:3.0:1787786316.527919:0:8446:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1787786316.527923:0:8446:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1787786316.527926:0:8446:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787786316.527933:0:8446:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787786316.527941:0:8446:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1787786316.527968:0:8446:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787786316.527971:0:8446:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787786316.528191:0:8446:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1787786316.528195:0:8446:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787786316.529672:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1787786316.531382:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1787786316.531472:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1787786316.531512:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1787786316.531530:0:8446:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787786316.531534:0:8446:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787786316.532746:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1787786316.534571:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1787786316.534633:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1787786316.534693:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1787786316.534723:0:8446:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787786316.534727:0:8446:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787786316.536244:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1787786316.536935:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1787786316.537015:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1787786316.537055:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1787786316.537073:0:8446:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787786316.537077:0:8446:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1787786316.538135:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1787786316.538655:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1787786316.538714:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1787786316.538748:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:1.0:1787786316.538977:0:8446:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787786316.539005:0:8446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b5201677c00/0x450132973bff20ca lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786316.539028:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b5201676600/0x450132973bff1fc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1fc0 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786316.539035:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b5201676c00/0x450132973bff1ff1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1fea expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786316.539041:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b520151b000/0x450132973bff201b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff2014 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786316.539048:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b520912c600/0x450132973bff2029 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff2022 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786316.539054:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b520912da00/0x450132973bff2037 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff2030 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786316.539061:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b52421d4400/0x450132973bff2053 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff204c expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786316.539067:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b52421d4e00/0x450132973bff207d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff2076 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786316.539077:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b5201676000/0x450132973bff208b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7520ca expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786316.539085:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b52421d5600/0x450132973bff2092 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7520d1 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786316.539094:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b5201677c00/0x450132973bff20ca lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786316.539157:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b52421d5600/0x450132973bff2092 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7520d1 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786316.539178:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b52421d5600/0x450132973bff2092 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7520d1 expref: 9 pid: 5840 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786316.539197:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874629686748416:192.168.204.34@tcp:104: 00010000:00010000:1.0:1787786316.539326:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b5201676000/0x450132973bff208b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7520ca expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786316.539348:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b5201676000/0x450132973bff208b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7520ca expref: 9 pid: 5839 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786316.539358:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874629686748544:192.168.204.34@tcp:104: 00010000:00010000:1.0:1787786316.539389:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b52421d4e00/0x450132973bff207d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff2076 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786316.539399:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b52421d4e00/0x450132973bff207d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff2076 expref: 18 pid: 5840 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786316.539409:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874629686748672:0@lo:104: 00000100:00100000:1.0:1787786316.539457:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787786316.539973:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b52421d4400/0x450132973bff2053 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff204c expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786316.539985:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b52421d4400/0x450132973bff2053 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff204c expref: 18 pid: 5840 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786316.540012:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874629686748800:0@lo:104: 00000100:00100000:1.0:1787786316.540047:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787786316.541023:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b520912da00/0x450132973bff2037 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff2030 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786316.541038:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b520912da00/0x450132973bff2037 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff2030 expref: 18 pid: 5840 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786316.541051:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874629686748928:0@lo:104: 00010000:00010000:1.0:1787786316.541091:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b520912c600/0x450132973bff2029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff2022 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786316.541100:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b520912c600/0x450132973bff2029 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff2022 expref: 18 pid: 5840 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786316.541108:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360f0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874629686749056:0@lo:104: 00010000:00010000:1.0:1787786316.541138:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b520151b000/0x450132973bff201b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff2014 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786316.541147:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b520151b000/0x450132973bff201b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff2014 expref: 18 pid: 5841 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786316.541154:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874629686749184:0@lo:104: 00010000:00010000:1.0:1787786316.541180:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b5201676c00/0x450132973bff1ff1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff1fea expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786316.541188:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b5201676c00/0x450132973bff1ff1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff1fea expref: 18 pid: 5839 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786316.541214:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874629686749312:0@lo:104: 00010000:00010000:1.0:1787786316.541245:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b5201676600/0x450132973bff1fc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff1fc0 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786316.541253:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b5201676600/0x450132973bff1fc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff1fc0 expref: 18 pid: 5839 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786316.541262:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874629686749440:0@lo:104: 00000100:00100000:1.0:1787786316.541283:0:8446:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5202f1fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1787786316.543364:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686748672 00000100:00100000:0.0:1787786316.543383:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686748672 00000100:00100000:0.0:1787786316.543512:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686748800 00000100:00100000:0.0:1787786316.543516:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686748800 00000100:00100000:1.0:1787786316.543748:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874629686748416:192.168.204.34@tcp:104: 00000100:00100000:1.0:1787786316.543777:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874629686748544:192.168.204.34@tcp:104: 00000100:00100000:2.0:1787786316.543964:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787786316.543984:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+4:8446:x1874629686748672:12345-0@lo:104: 00010000:00010000:2.0:1787786316.544006:0:7632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff2076 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff207d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786316.544100:0:7632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787786316.544106:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+4:8446:x1874629686748672:12345-0@lo:104: Request processed in 132us (4650us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786316.544114:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787786316.544138:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787786316.544145:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4b7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+3:8446:x1874629686748800:12345-0@lo:104: 00010000:00010000:2.0:1787786316.544154:0:7632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff8b520151a200/0x450132973bff204c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff2053 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786316.544193:0:7632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787786316.544198:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4b7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+3:8446:x1874629686748800:12345-0@lo:104: Request processed in 54us (4151us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786316.544204:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787786316.544266:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786316.544286:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786316.544340:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786316.544356:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786316.544366:0:7632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786316.544376:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686748928 00000100:00100000:2.0:1787786316.544381:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686748928 00000100:00100000:2.0:1787786316.544401:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686749056 00000100:00100000:2.0:1787786316.544404:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686749056 00000100:00100000:2.0:1787786316.544414:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686749184 00000100:00100000:2.0:1787786316.544424:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686749184 00000100:00100000:2.0:1787786316.544439:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686749312 00000100:00100000:2.0:1787786316.544442:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686749312 00000100:00100000:2.0:1787786316.544451:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686749440 00000100:00100000:2.0:1787786316.544453:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686749440 00000100:00100000:2.0:1787786316.544464:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787786316.544470:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221a9cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+7:8446:x1874629686748928:12345-0@lo:104: 00010000:00010000:2.0:1787786316.544478:0:7632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff2030 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff2037 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786316.544525:0:7632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787786316.544532:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221a9cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+7:8446:x1874629686748928:12345-0@lo:104: Request processed in 62us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786316.544539:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787786316.544554:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787786316.544561:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221a9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+6:8446:x1874629686749056:12345-0@lo:104: 00010000:00010000:2.0:1787786316.544569:0:7632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff8b520912c000/0x450132973bff2022 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff2029 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786316.544598:0:7632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787786316.544603:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221a9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+6:8446:x1874629686749056:12345-0@lo:104: Request processed in 44us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786316.544608:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787786316.544619:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787786316.544625:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206352d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+5:8446:x1874629686749184:12345-0@lo:104: 00010000:00010000:2.0:1787786316.544632:0:7632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff8b520912ce00/0x450132973bff2014 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff201b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786316.544658:0:7632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1787786316.544669:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206352d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+5:8446:x1874629686749184:12345-0@lo:104: Request processed in 44us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786316.544675:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787786316.544688:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787786316.544694:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52063530c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+4:8446:x1874629686749312:12345-0@lo:104: 00010000:00010000:2.0:1787786316.544702:0:7632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff8b52421d5400/0x450132973bff1fea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1ff1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786316.544732:0:7632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1787786316.544737:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52063530c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+4:8446:x1874629686749312:12345-0@lo:104: Request processed in 44us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786316.544742:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787786316.544754:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1787786316.545127:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1787786316.545136:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff2076 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff207d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.545146:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d4000 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:3.0:1787786316.545151:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff2076 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff207d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.545161:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff2076 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff207d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787786316.545170:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff2076 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff207d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786316.545222:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787786316.545271:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff2076 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff207d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.545278:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787786316.545303:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff2076 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff207d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.545312:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff2076 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff207d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.545352:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1787786316.545356:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b520151a200/0x450132973bff204c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff2053 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.545363:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520151a200 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:3.0:1787786316.545367:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b520151a200/0x450132973bff204c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff2053 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.545375:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b520151a200/0x450132973bff204c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff2053 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787786316.545382:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b520151a200/0x450132973bff204c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff2053 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786316.545389:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787786316.545403:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b520151a200/0x450132973bff204c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff2053 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.545409:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787786316.545415:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b520151a200/0x450132973bff204c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff2053 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.545422:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b520151a200/0x450132973bff204c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff2053 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.545433:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787786316.545437:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff2030 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff2037 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.545454:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912d800 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:3.0:1787786316.545457:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff2030 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff2037 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.545465:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff2030 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff2037 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787786316.545472:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff2030 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff2037 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786316.545478:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787786316.545491:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff2030 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff2037 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.545498:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787786316.545516:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff2030 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff2037 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.545523:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff2030 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff2037 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.545533:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787786316.545536:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b520912c000/0x450132973bff2022 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff2029 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.545542:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912c000 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:3.0:1787786316.545544:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b520912c000/0x450132973bff2022 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff2029 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.545561:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b520912c000/0x450132973bff2022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff2029 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787786316.545567:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b520912c000/0x450132973bff2022 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff2029 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786316.545573:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787786316.545588:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b520912c000/0x450132973bff2022 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff2029 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.545594:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787786316.545601:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b520912c000/0x450132973bff2022 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff2029 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.545608:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b520912c000/0x450132973bff2022 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff2029 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.545617:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787786316.545621:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b520912ce00/0x450132973bff2014 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff201b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.545626:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912ce00 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:3.0:1787786316.545629:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b520912ce00/0x450132973bff2014 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff201b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.545636:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b520912ce00/0x450132973bff2014 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff201b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787786316.545641:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b520912ce00/0x450132973bff2014 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff201b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786316.545652:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787786316.545667:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b520912ce00/0x450132973bff2014 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff201b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.545673:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787786316.545678:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b520912ce00/0x450132973bff2014 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff201b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.545684:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b520912ce00/0x450132973bff2014 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff201b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.545694:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787786316.545697:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b52421d5400/0x450132973bff1fea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1ff1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.545702:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d5400 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:3.0:1787786316.545705:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b52421d5400/0x450132973bff1fea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff1ff1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.545711:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b52421d5400/0x450132973bff1fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff1ff1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787786316.545717:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b52421d5400/0x450132973bff1fea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff1ff1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786316.545722:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787786316.545734:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b52421d5400/0x450132973bff1fea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1ff1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.545740:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787786316.545751:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b52421d5400/0x450132973bff1fea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1ff1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.545757:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b52421d5400/0x450132973bff1fea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1ff1 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.545865:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786316.545867:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786316.545870:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786316.545933:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786316.546194:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786316.546238:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc9b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686749696:0@lo:103: 00000100:00100000:3.0:1787786316.546288:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786316.546341:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686750208:0@lo:103: 00000100:00100000:3.0:1787786316.546363:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786316.546381:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787786316.546387:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc9ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686749568:0@lo:103: 00000100:00100000:3.0:1787786316.546407:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786316.546417:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc9b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686750080:0@lo:103: 00000100:00100000:3.0:1787786316.546435:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786316.546455:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc98780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686749824:0@lo:103: 00000100:00100000:3.0:1787786316.546481:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786316.546494:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787786316.546499:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc9bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686749952:0@lo:103: 00000100:00100000:3.0:1787786316.546521:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786316.546553:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667852288 00000100:00100000:3.0:1787786316.546561:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667852288 00010000:00010000:3.0:1787786316.546599:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b52421d5600/0x450132973bff2092 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7520d1 expref: 10 pid: 5840 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786316.546635:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667852416 00000100:00100000:3.0:1787786316.546639:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667852416 00010000:00010000:3.0:1787786316.546653:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b5201676000/0x450132973bff208b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7520ca expref: 11 pid: 5839 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786316.546665:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686749696 00000100:00100000:3.0:1787786316.546667:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686749696 00010000:00010000:3.0:1787786316.546680:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b52421d4400/0x450132973bff2053 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff204c expref: 19 pid: 5840 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786316.546689:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686750208 00000100:00100000:3.0:1787786316.546692:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686750208 00010000:00010000:3.0:1787786316.546701:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b5201676c00/0x450132973bff1ff1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1fea expref: 20 pid: 5839 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786316.546710:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686749568 00000100:00100000:3.0:1787786316.546712:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686749568 00010000:00010000:3.0:1787786316.546722:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b52421d4e00/0x450132973bff207d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff2076 expref: 21 pid: 5840 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786316.546731:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686750080 00000100:00100000:3.0:1787786316.546733:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686750080 00010000:00010000:3.0:1787786316.546743:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b520151b000/0x450132973bff201b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff2014 expref: 22 pid: 5841 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786316.546752:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686749824 00000100:00100000:3.0:1787786316.546754:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686749824 00000100:00100000:1.0:1787786316.546969:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874629686748672:0@lo:104: 00000100:00100000:1.0:1787786316.546983:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874629686748800:0@lo:104: 00000100:00100000:1.0:1787786316.546992:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874629686748928:0@lo:104: 00000100:00100000:1.0:1787786316.547001:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360f0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874629686749056:0@lo:104: 00000100:00100000:1.0:1787786316.547012:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360c780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874629686749184:0@lo:104: 00000100:00100000:1.0:1787786316.547020:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874629686749312:0@lo:104: 00010000:00010000:3.0:1787786316.547395:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b520912da00/0x450132973bff2037 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff2030 expref: 23 pid: 5840 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786316.547416:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686749952 00000100:00100000:3.0:1787786316.547429:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686749952 00010000:00010000:3.0:1787786316.547446:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b520912c600/0x450132973bff2029 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff2022 expref: 24 pid: 5840 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786316.547464:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00100000:3.0:1787786316.547474:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc9a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+11:2365:x1874629667852288:12345-192.168.204.34@tcp:103: 00010000:00010000:3.0:1787786316.547492:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786316.547500:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b52421d5600/0x450132973bff2092 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7520d1 expref: 11 pid: 5840 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.547515:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b52421d5600/0x450132973bff2092 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7520d1 expref: 11 pid: 5840 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.547539:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b52421d5600/0x450132973bff2092 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7520d1 expref: 11 pid: 5840 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.547560:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787786316.547710:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206350780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+3:8446:x1874629686749440:12345-0@lo:104: 00010000:00010000:2.0:1787786316.547727:0:7632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff8b520151aa00/0x450132973bff1fc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1fc7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786316.547823:0:7632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787786316.547830:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206350780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+3:8446:x1874629686749440:12345-0@lo:104: Request processed in 3070us (3463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786316.547840:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787786316.547959:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc9a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:2365:x1874629667852288:12345-192.168.204.34@tcp:103: Request processed in 476us (2019us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786316.547967:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00100000:3.0:1787786316.547986:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 13 00000100:00100000:3.0:1787786316.547994:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc9a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+9:2364:x1874629667852416:12345-192.168.204.34@tcp:103: 00010000:00010000:3.0:1787786316.548004:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786316.548010:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b5201676000/0x450132973bff208b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7520ca expref: 9 pid: 5839 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.548021:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b5201676000/0x450132973bff208b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7520ca expref: 9 pid: 5839 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.548046:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5201676000/0x450132973bff208b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7520ca expref: 9 pid: 5839 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.548057:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787786316.548077:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc9a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+8:2364:x1874629667852416:12345-192.168.204.34@tcp:103: Request processed in 84us (1884us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786316.548084:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 13 00000100:00100000:3.0:1787786316.548096:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787786316.548103:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc99a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+24:3312:x1874629686749696:12345-0@lo:103: 00010000:00010000:3.0:1787786316.548111:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786316.548116:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b52421d4400/0x450132973bff2053 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff204c expref: 24 pid: 5840 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.548125:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b52421d4400/0x450132973bff2053 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff204c expref: 24 pid: 5840 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.548137:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b52421d4400/0x450132973bff2053 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff204c expref: 24 pid: 5840 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.548146:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787786316.548175:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc99a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+23:3312:x1874629686749696:12345-0@lo:103: Request processed in 72us (1886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786316.548181:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787786316.548194:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787786316.548200:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc98f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+22:3312:x1874629686750208:12345-0@lo:103: 00010000:00010000:3.0:1787786316.548209:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786316.548213:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b5201676c00/0x450132973bff1ff1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1fea expref: 22 pid: 5839 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.548228:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b5201676c00/0x450132973bff1ff1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff1fea expref: 22 pid: 5839 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.548239:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5201676c00/0x450132973bff1ff1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff1fea expref: 22 pid: 5839 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.548249:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787786316.548272:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc98f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+21:3312:x1874629686750208:12345-0@lo:103: Request processed in 72us (1908us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786316.548279:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787786316.548291:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787786316.548297:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5205316d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+20:3312:x1874629686749568:12345-0@lo:103: 00010000:00010000:3.0:1787786316.548321:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786316.548326:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b52421d4e00/0x450132973bff207d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff2076 expref: 20 pid: 5840 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.548349:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b52421d4e00/0x450132973bff207d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff2076 expref: 20 pid: 5840 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.548360:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b52421d4e00/0x450132973bff207d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff2076 expref: 20 pid: 5840 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.548369:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787786316.548391:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5205316d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3312:x1874629686749568:12345-0@lo:103: Request processed in 95us (1984us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786316.548397:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787786316.548411:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787786316.548417:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5205314780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:3312:x1874629686750080:12345-0@lo:103: 00010000:00010000:3.0:1787786316.548431:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786316.548436:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b520151b000/0x450132973bff201b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff2014 expref: 18 pid: 5841 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.548446:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b520151b000/0x450132973bff201b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff2014 expref: 18 pid: 5841 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.548456:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b520151b000/0x450132973bff201b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff2014 expref: 18 pid: 5841 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.548466:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787786316.548489:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5205314780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:3312:x1874629686750080:12345-0@lo:103: Request processed in 72us (2053us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786316.548496:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787786316.548508:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787786316.548514:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5207bddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:3313:x1874629686749824:12345-0@lo:103: 00010000:00010000:3.0:1787786316.548522:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786316.548527:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b520912da00/0x450132973bff2037 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff2030 expref: 16 pid: 5840 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.548535:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b520912da00/0x450132973bff2037 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff2030 expref: 16 pid: 5840 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.548544:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b520912da00/0x450132973bff2037 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff2030 expref: 16 pid: 5840 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.548552:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787786316.548584:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5207bddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:3313:x1874629686749824:12345-0@lo:103: Request processed in 70us (2102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786316.548599:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787786316.548650:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787786316.548657:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:3313:x1874629686749952:12345-0@lo:103: 00010000:00010000:3.0:1787786316.548664:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786316.548668:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b520912c600/0x450132973bff2029 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff2022 expref: 14 pid: 5840 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.548676:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b520912c600/0x450132973bff2029 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff2022 expref: 14 pid: 5840 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.548685:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b520912c600/0x450132973bff2029 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff2022 expref: 14 pid: 5840 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786316.548694:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787786316.548717:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:3313:x1874629686749952:12345-0@lo:103: Request processed in 61us (2196us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786316.548723:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787786316.548875:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc9ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686749568:0@lo:103: 00000100:00100000:2.0:1787786316.548885:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc9b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686750080:0@lo:103: 00000100:00100000:2.0:1787786316.548893:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc9b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686749696:0@lo:103: 00000100:00100000:2.0:1787786316.548900:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686750208:0@lo:103: 00010000:00010000:0.0:1787786316.549252:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787786316.549263:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b520151aa00/0x450132973bff1fc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1fc7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786316.549272:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520151aa00 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:0.0:1787786316.549277:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b520151aa00/0x450132973bff1fc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff1fc7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786316.549286:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b520151aa00/0x450132973bff1fc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff1fc7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787786316.549293:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b520151aa00/0x450132973bff1fc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff1fc7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787786316.549299:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787786316.549353:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b520151aa00/0x450132973bff1fc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1fc7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786316.549360:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787786316.549389:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b520151aa00/0x450132973bff1fc0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1fc7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786316.549397:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b520151aa00/0x450132973bff1fc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1fc7 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786316.549416:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786316.549418:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786316.549420:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786316.549428:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786316.549443:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787786316.549459:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bf85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3314:1874629686750336:0@lo:103: 00000100:00100000:0.0:1787786316.549512:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786316.549572:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:0.0:1787786316.549599:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686750336 00000100:00100000:0.0:1787786316.549606:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686750336 00010000:00010000:0.0:1787786316.549637:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b5201676600/0x450132973bff1fc7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1fc0 expref: 13 pid: 5839 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786316.549663:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787786316.549671:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf86940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:3314:x1874629686750336:12345-0@lo:103: 00010000:00010000:0.0:1787786316.549681:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787786316.549685:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b5201676600/0x450132973bff1fc7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1fc0 expref: 13 pid: 5839 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786316.549696:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b5201676600/0x450132973bff1fc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff1fc0 expref: 13 pid: 5839 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786316.549714:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b5201677c00/0x450132973bff20ca lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786316.549736:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5201677c00/0x450132973bff20ca lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786316.549752:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b5201677c00/0x450132973bff20ca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786316.549774:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b5201677c00/0x450132973bff20ca lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786316.549781:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b5201677c00/0x450132973bff20ca lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786316.549787:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b5201677c00/0x450132973bff20ca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786316.549817:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5201677c00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:0.0:1787786316.549822:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b5201677c00/0x450132973bff20ca lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786316.549830:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b5201677c00/0x450132973bff20ca lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786316.549839:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b5201677c00/0x450132973bff20ca lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786316.549851:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787786316.549885:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf86940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:3314:x1874629686750336:12345-0@lo:103: Request processed in 214us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786316.549894:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787786316.549928:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bf85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3314:1874629686750336:0@lo:103: 00000100:00100000:3.0:1787786316.550373:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc9bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686749952:0@lo:103: 00000100:00100000:3.0:1787786316.550386:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc98780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686749824:0@lo:103: 00010000:00010000:3.0:1787786316.550423:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786316.551938:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5201676600/0x450132973bff1fc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff1fc0 expref: 12 pid: 5839 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786316.551966:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1874629686749440:0@lo:104: 00010000:00010000:0.0:1787786316.552025:0:8446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b5201677c00/0x450132973bff20ca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786316.552038:0:8446:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b5201677c00/0x450132973bff20ca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786316.552046:0:8446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b5201677c00/0x450132973bff20ca lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786316.552053:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5201677c00/0x450132973bff20ca lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786317.258570:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786317.753108:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786317.753170:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786317.753208:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786317.753263:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786317.753332:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667852544 00000100:00100000:3.0:1787786317.753346:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667852544 00000100:00100000:0.0:1787786317.753360:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667852672 00000100:00100000:0.0:1787786317.753368:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667852672 00000100:00100000:0.0:1787786317.753440:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 26 00000100:00100000:0.0:1787786317.753454:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+6:2364:x1874629667852672:12345-192.168.204.34@tcp:400: 00000100:00100000:0.0:1787786317.753548:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+6:2364:x1874629667852672:12345-192.168.204.34@tcp:400: Request processed in 99us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786317.753557:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 26 00000100:00100000:3.0:1787786317.753581:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 131 00000100:00100000:0.0:1787786317.753590:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667852928 00000100:00100000:3.0:1787786317.753594:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+8:2365:x1874629667852544:12345-192.168.204.34@tcp:400: 00000100:00100000:0.0:1787786317.753595:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667852928 00000100:00100000:3.0:1787786317.753634:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+8:2365:x1874629667852544:12345-192.168.204.34@tcp:400: Request processed in 45us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786317.753641:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667852800 00000100:00100000:0.0:1787786317.753645:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667852800 00000100:00100000:3.0:1787786317.753666:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 131 00000100:00100000:0.0:1787786317.753675:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 11 00000100:00100000:0.0:1787786317.753684:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:173d08e0-0e54-474e-858e-1679cd38cf14+5:2364:x1874629667852928:12345-192.168.204.34@tcp:400: 00000100:00100000:0.0:1787786317.753725:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:173d08e0-0e54-474e-858e-1679cd38cf14+5:2364:x1874629667852928:12345-192.168.204.34@tcp:400: Request processed in 43us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786317.753733:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 11 00000100:00100000:0.0:1787786317.753747:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00100000:0.0:1787786317.753755:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:173d08e0-0e54-474e-858e-1679cd38cf14+5:2365:x1874629667852800:12345-192.168.204.34@tcp:400: 00000100:00100000:0.0:1787786317.753782:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:173d08e0-0e54-474e-858e-1679cd38cf14+5:2365:x1874629667852800:12345-192.168.204.34@tcp:400: Request processed in 28us (518us total) trans 0 rc 0/0 00000100:00080000:1.0:1787786317.753904:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787786317.753910:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787786317.753913:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787786317.753973:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 12 10000000:01000000:3.0:1787786318.153968:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787786318.153980:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8b5213768000 from 39 10000000:01000000:3.0:1787786318.153986:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787786318.154410:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7200/0x450132973bff20d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786318.154426:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7200/0x450132973bff20d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786318.154541:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7200/0x450132973bff20d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786318.154574:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c09680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686750464:0@lo:101: 00000100:00100000:3.0:1787786318.154672:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786318.154773:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b521145ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787786318.155103:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686750464 00000100:00100000:0.0:1787786318.155115:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686750464 00000100:00100000:0.0:1787786318.155191:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787786318.155204:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+12:5843:x1874629686750464:12345-0@lo:101: 00010000:00010000:0.0:1787786318.155223:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786318.155244:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b520912de00/0x450132973bff20d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff20d1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786318.156768:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b520912de00/0x450132973bff20d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff20d1 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786318.156785:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b520912de00/0x450132973bff20d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff20d1 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786318.156813:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912de00, rc 0) 00000100:00100000:0.0:1787786318.156935:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:5843:x1874629686750464:12345-0@lo:101: Request processed in 1732us (2262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786318.156946:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787786318.158194:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c09680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686750464:0@lo:101: 00010000:00010000:3.0:1787786318.158227:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7200/0x450132973bff20d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff20d8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786318.158240:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7200/0x450132973bff20d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff20d8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786318.158355:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c09680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686750592:0@lo:501: 00000100:00100000:3.0:1787786318.158417:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786318.158732:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b521145ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1787786318.159697:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686750592 00000100:00100000:1.0:1787786318.159712:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686750592 00000100:00100000:1.0:1787786318.159822:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787786318.159836:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:5843:x1874629686750592:12345-0@lo:501: 00000100:00100000:1.0:1787786318.161271:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:5843:x1874629686750592:12345-0@lo:501: Request processed in 1427us (2842us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786318.161286:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1787786318.167986:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c09680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686750592:0@lo:501: 00000100:00100000:3.0:1787786318.168422:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c09680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686750720:0@lo:503: 00000100:00100000:3.0:1787786318.169687:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786318.169751:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b521145ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787786318.173143:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686750720 00000100:00100000:0.0:1787786318.173266:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686750720 00000100:00100000:0.0:1787786318.174396:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787786318.174414:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:5843:x1874629686750720:12345-0@lo:503: 00000100:00100000:0.0:1787786318.174966:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:5843:x1874629686750720:12345-0@lo:503: Request processed in 557us (5279us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786318.174976:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787786318.175212:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c09680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686750720:0@lo:503: 00000100:00100000:1.0:1787786318.176134:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8464:1874629686750848:0@lo:502: 00000100:00100000:1.0:1787786318.176222:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786318.176268:0:8464:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5202f1ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787786318.176631:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686750848 00000100:00100000:3.0:1787786318.176641:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686750848 00000100:00100000:3.0:1787786318.176700:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787786318.176711:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:8464:x1874629686750848:12345-0@lo:502: 00000100:00100000:3.0:1787786318.177071:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:8464:x1874629686750848:12345-0@lo:502: Request processed in 360us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786318.177080:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787786318.177942:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8464:1874629686750848:0@lo:502: 00000100:00100000:1.0:1787786318.178039:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8464:1874629686750976:0@lo:502: 00000100:00100000:1.0:1787786318.178102:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786318.178156:0:8464:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5202f1ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787786318.179901:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686750976 00000100:00100000:3.0:1787786318.179920:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686750976 00000100:00100000:3.0:1787786318.180015:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787786318.180028:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:8464:x1874629686750976:12345-0@lo:502: 00000100:00100000:3.0:1787786318.180718:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:8464:x1874629686750976:12345-0@lo:502: Request processed in 689us (2611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786318.180728:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1787786318.181238:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8464:1874629686750976:0@lo:502: 00000040:00080000:2.0:1787786318.181308:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787786318.182368:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787786318.182427:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787786318.182457:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7200/0x450132973bff20d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff20d8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786318.182471:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7200/0x450132973bff20d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff20d8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786318.182485:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1787786318.182488:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1787786318.182491:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1787786318.182543:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6c00/0x450132973bff20df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786318.182565:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6c00/0x450132973bff20df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786318.182579:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6c00/0x450132973bff20df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786318.182609:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686751104:0@lo:101: 00000100:00100000:3.0:1787786318.182688:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786318.182745:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b521145fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787786318.182943:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686751104 00000100:00100000:0.0:1787786318.182954:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686751104 00000100:00100000:0.0:1787786318.183026:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787786318.183038:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+13:5843:x1874629686751104:12345-0@lo:101: 00010000:00010000:0.0:1787786318.183053:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786318.183071:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b520912d000/0x450132973bff20e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff20df expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786318.183102:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b520912d000/0x450132973bff20e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff20df expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786318.183114:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b520912d000/0x450132973bff20e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff20df expref: 14 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786318.183124:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912d000, rc 0) 00000100:00100000:0.0:1787786318.183184:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:5843:x1874629686751104:12345-0@lo:101: Request processed in 149us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786318.183192:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787786318.183779:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686751104:0@lo:101: 00010000:00010000:3.0:1787786318.183950:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6c00/0x450132973bff20df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff20e6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786318.183962:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6c00/0x450132973bff20df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff20e6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786318.184047:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686751232:0@lo:501: 00000100:00100000:3.0:1787786318.184093:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786318.184175:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b521145fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787786318.191500:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686751232 00000100:00100000:2.0:1787786318.191524:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686751232 00000100:00100000:2.0:1787786318.191628:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787786318.191642:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:5843:x1874629686751232:12345-0@lo:501: 00000100:00100000:2.0:1787786318.192122:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:5843:x1874629686751232:12345-0@lo:501: Request processed in 482us (8026us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786318.192132:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1787786318.193952:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c0b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686751232:0@lo:501: 00000100:00100000:0.0:1787786318.194056:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bf852c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686751360:0@lo:503: 00000100:00100000:0.0:1787786318.194162:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786318.194224:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52112e3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787786318.194278:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686751360 00000100:00100000:3.0:1787786318.194286:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686751360 00000100:00100000:3.0:1787786318.194360:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787786318.194370:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:5843:x1874629686751360:12345-0@lo:503: 00000100:00100000:3.0:1787786318.195109:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:5843:x1874629686751360:12345-0@lo:503: Request processed in 736us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786318.195120:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1787786318.195374:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bf852c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686751360:0@lo:503: 00000100:00100000:0.0:1787786318.196213:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bf852c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8465:1874629686751488:0@lo:502: 00000100:00100000:0.0:1787786318.196287:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786318.196346:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52112e3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787786318.196607:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686751488 00000100:00100000:1.0:1787786318.196614:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686751488 00000100:00100000:1.0:1787786318.196675:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1787786318.196687:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:8465:x1874629686751488:12345-0@lo:502: 00000100:00100000:1.0:1787786318.196979:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:8465:x1874629686751488:12345-0@lo:502: Request processed in 294us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786318.196988:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787786318.197276:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bf852c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8465:1874629686751488:0@lo:502: 00000020:01000000:0.0:1787786318.197322:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787786318.197333:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787786318.197336:0:8465:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787786318.197343:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787786318.197371:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bf852c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8465:1874629686751616:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787786318.197425:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786318.197456:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52067fd840 going to sleep for 11 seconds 00000100:00100000:2.0:1787786318.197598:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686751616 00000100:00100000:2.0:1787786318.197604:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686751616 00000100:00100000:2.0:1787786318.197645:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787786318.197654:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:8465:x1874629686751616:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787786318.197833:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:8465:x1874629686751616:12345-0@lo:502:llog_process_th.0 Request processed in 180us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786318.197841:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1787786318.198138:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bf852c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8465:1874629686751616:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787786318.198160:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787786318.198174:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787786318.198176:0:8465:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787786318.198181:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1787786318.198682:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1787786318.198709:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787786318.198722:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6c00/0x450132973bff20df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff20e6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786318.198753:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6c00/0x450132973bff20df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff20e6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787786318.198767:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787786318.198770:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8b5206233000 from 39 10000000:01000000:1.0:1787786318.198773:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787786318.198853:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b5201676a00/0x450132973bff20ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786318.198862:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b5201676a00/0x450132973bff20ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786318.198872:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b5201676a00/0x450132973bff20ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786318.198896:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686751744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787786318.198952:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786318.198991:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5202f1f240 going to sleep for 11 seconds 00000100:00100000:2.0:1787786318.199140:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686751744 00000100:00100000:2.0:1787786318.199148:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686751744 00000100:00100000:2.0:1787786318.199214:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787786318.199225:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:5843:x1874629686751744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787786318.199239:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786318.199254:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b520151aa00/0x450132973bff20f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff20ed expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786318.199283:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b520151aa00/0x450132973bff20f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff20ed expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786318.199295:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b520151aa00/0x450132973bff20f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff20ed expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786318.199326:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520151aa00, rc 0) 00000100:00100000:2.0:1787786318.199376:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:5843:x1874629686751744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786318.199394:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787786318.199649:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686751744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787786318.199664:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b5201676a00/0x450132973bff20ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff20f4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786318.199674:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b5201676a00/0x450132973bff20ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff20f4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786318.199736:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686751872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787786318.199768:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786318.200063:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5202f1f240 going to sleep for 11 seconds 00000100:00100000:3.0:1787786318.200134:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686751872 00000100:00100000:3.0:1787786318.200140:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686751872 00000100:00100000:3.0:1787786318.200196:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787786318.200205:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:5843:x1874629686751872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787786318.201240:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:5843:x1874629686751872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1029us (1464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786318.201252:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787786318.201698:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686751872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787786318.201761:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686752000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787786318.201864:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786318.201900:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5202f1f240 going to sleep for 11 seconds 00000100:00100000:2.0:1787786318.202066:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686752000 00000100:00100000:2.0:1787786318.202076:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686752000 00000100:00100000:2.0:1787786318.202121:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787786318.202132:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:5843:x1874629686752000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787786318.203614:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:5843:x1874629686752000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1475us (1742us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786318.203629:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787786318.209939:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686752000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787786318.211205:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8466:1874629686752128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787786318.211326:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786318.211410:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5202f1ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787786318.211720:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686752128 00000100:00100000:0.0:1787786318.211736:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686752128 00000100:00100000:0.0:1787786318.211829:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787786318.211840:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:8466:x1874629686752128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787786318.212216:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:8466:x1874629686752128:12345-0@lo:502:llog_process_th.0 Request processed in 378us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786318.212225:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787786318.212838:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8466:1874629686752128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787786318.212921:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8466:1874629686752256:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787786318.212979:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786318.213077:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5202f1ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787786318.215367:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686752256 00000100:00100000:3.0:1787786318.215400:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686752256 00000100:00100000:3.0:1787786318.215506:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1787786318.215518:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:8466:x1874629686752256:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787786318.215959:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:8466:x1874629686752256:12345-0@lo:502:llog_process_th.0 Request processed in 442us (2977us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786318.215970:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787786318.217430:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8466:1874629686752256:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787786318.217497:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787786318.218026:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787786318.218055:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787786318.218070:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b5201676a00/0x450132973bff20ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff20f4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786318.218083:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b5201676a00/0x450132973bff20ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff20f4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787786318.218096:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787786318.218099:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1787786318.218102:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787786318.218154:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520151b600/0x450132973bff20fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786318.218174:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b520151b600/0x450132973bff20fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786318.218207:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b520151b600/0x450132973bff20fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786318.218236:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5206350b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686752384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787786318.218328:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786318.218379:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5208f50780 going to sleep for 11 seconds 00000100:00100000:1.0:1787786318.218966:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686752384 00000100:00100000:1.0:1787786318.218979:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686752384 00000100:00100000:1.0:1787786318.219057:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787786318.219068:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:5843:x1874629686752384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787786318.219090:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786318.219113:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5201677800/0x450132973bff2102 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff20fb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786318.219147:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5201677800/0x450132973bff2102 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff20fb expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786318.219317:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5201677800/0x450132973bff2102 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff20fb expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786318.219327:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5201677800, rc 0) 00000100:00100000:1.0:1787786318.219626:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:5843:x1874629686752384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 558us (1296us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786318.219634:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787786318.236101:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5206350b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686752384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787786318.236145:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b520151b600/0x450132973bff20fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2102 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786318.236172:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b520151b600/0x450132973bff20fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff2102 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786318.236287:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c092c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686752512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787786318.236387:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786318.236564:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b521145f540 going to sleep for 11 seconds 00000100:00100000:1.0:1787786318.240663:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686752512 00000100:00100000:1.0:1787786318.240687:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686752512 00000100:00100000:1.0:1787786318.240754:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787786318.240768:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:5843:x1874629686752512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787786318.241264:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:5843:x1874629686752512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 498us (4875us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786318.241274:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787786318.242379:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c092c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686752512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787786318.242537:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c092c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686752640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787786318.242640:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786318.242685:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b521145f540 going to sleep for 11 seconds 00000100:00100000:3.0:1787786318.242706:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686752640 00000100:00100000:3.0:1787786318.242712:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686752640 00000100:00100000:3.0:1787786318.242761:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787786318.242772:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:5843:x1874629686752640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787786318.243021:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:5843:x1874629686752640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 249us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786318.243029:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787786318.243080:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c092c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686752640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787786318.243370:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c092c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8467:1874629686752768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787786318.244318:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786318.244371:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b521145f780 going to sleep for 11 seconds 00000100:00100000:1.0:1787786318.244572:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686752768 00000100:00100000:1.0:1787786318.244580:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686752768 00000100:00100000:1.0:1787786318.244642:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787786318.244653:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:8467:x1874629686752768:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787786318.245162:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:8467:x1874629686752768:12345-0@lo:502:llog_process_th.0 Request processed in 509us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786318.245283:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c092c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8467:1874629686752768:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787786318.245341:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787786318.245355:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786318.245358:0:8467:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787786318.245366:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787786318.245421:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5206350f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8467:1874629686752896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787786318.245477:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786318.245506:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5208f506c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787786318.245611:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787786318.245655:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686752896 00000100:00100000:1.0:1787786318.245661:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686752896 00000100:00100000:1.0:1787786318.245687:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787786318.245695:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:8467:x1874629686752896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787786318.246422:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:8467:x1874629686752896:12345-0@lo:502:llog_process_th.0 Request processed in 722us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786318.246434:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787786318.251787:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5206350f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8467:1874629686752896:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787786318.251986:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787786318.252004:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787786318.252008:0:8467:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787786318.252030:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1787786318.252348:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1787786318.252396:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787786318.252422:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520151b600/0x450132973bff20fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2102 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786318.252435:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b520151b600/0x450132973bff20fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2102 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786318.252449:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787786318.252452:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8b5207b73000 from 39 10000000:01000000:3.0:1787786318.252455:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787786318.252503:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6400/0x450132973bff2109 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786318.252511:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6400/0x450132973bff2109 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786318.252531:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6400/0x450132973bff2109 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786318.252563:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c08f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686753024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787786318.252659:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786318.252757:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b521145f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787786318.255234:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686753024 00000100:00100000:1.0:1787786318.255255:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686753024 00000100:00100000:1.0:1787786318.255598:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1787786318.255613:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:5843:x1874629686753024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787786318.255637:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786318.255664:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5201676400/0x450132973bff2110 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff2109 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786318.255701:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5201676400/0x450132973bff2110 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff2109 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786318.255716:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5201676400/0x450132973bff2110 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff2109 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786318.255727:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5201676400, rc 0) 00000100:00100000:1.0:1787786318.255870:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:5843:x1874629686753024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 261us (3212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786318.255878:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787786318.256001:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c08f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686753024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787786318.256027:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6400/0x450132973bff2109 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2110 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786318.256040:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6400/0x450132973bff2109 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff2110 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786318.256151:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bf852c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686753152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787786318.256215:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786318.263832:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52112e3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787786318.267641:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686753152 00000100:00100000:3.0:1787786318.267667:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686753152 00000100:00100000:3.0:1787786318.267951:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787786318.267963:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:5843:x1874629686753152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787786318.268712:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:5843:x1874629686753152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 746us (12492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786318.268724:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787786318.268881:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bf852c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686753152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787786318.268953:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bf852c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686753280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787786318.269015:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786318.269049:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52112e3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787786318.269106:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686753280 00000100:00100000:3.0:1787786318.269113:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686753280 00000100:00100000:3.0:1787786318.269144:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1787786318.269152:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:5843:x1874629686753280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787786318.269746:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:5843:x1874629686753280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 591us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786318.269754:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787786318.279691:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bf852c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686753280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787786318.280674:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8468:1874629686753408:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787786318.280830:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786318.280892:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b522cc54d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787786318.282460:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686753408 00000100:00100000:3.0:1787786318.282478:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686753408 00000100:00100000:3.0:1787786318.282561:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1787786318.282573:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:8468:x1874629686753408:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787786318.282998:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:8468:x1874629686753408:12345-0@lo:502:llog_process_th.0 Request processed in 426us (2207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786318.283015:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00010000:00010000:3.0:1787786318.283120:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786318.288126:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8468:1874629686753408:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787786318.288271:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8468:1874629686753536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787786318.288414:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786318.288471:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5207397a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787786318.288718:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686753536 00000100:00100000:3.0:1787786318.288728:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686753536 00000100:00100000:3.0:1787786318.288824:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787786318.288838:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:8468:x1874629686753536:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787786318.289196:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:8468:x1874629686753536:12345-0@lo:502:llog_process_th.0 Request processed in 361us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786318.289205:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787786318.289541:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360f0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8468:1874629686753536:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787786318.289574:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787786318.289888:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787786318.289913:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787786318.289925:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6400/0x450132973bff2109 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2110 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786318.289938:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6400/0x450132973bff2109 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2110 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786318.289950:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787786318.289954:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1787786318.289957:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787786318.289995:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6e00/0x450132973bff2117 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786318.290003:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6e00/0x450132973bff2117 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786318.290013:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6e00/0x450132973bff2117 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786318.290047:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c09a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686753664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787786318.290096:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786318.290126:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b521145f480 going to sleep for 11 seconds 00000100:00100000:2.0:1787786318.290212:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686753664 00000100:00100000:2.0:1787786318.290219:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686753664 00000100:00100000:2.0:1787786318.290271:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787786318.290281:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:5843:x1874629686753664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787786318.290306:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786318.290324:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b520151a800/0x450132973bff211e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff2117 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786318.290356:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b520151a800/0x450132973bff211e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff2117 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786318.290391:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b520151a800/0x450132973bff211e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff2117 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786318.290403:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520151a800, rc 0) 00000100:00100000:2.0:1787786318.290450:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:5843:x1874629686753664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786318.290457:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787786318.290930:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c09a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686753664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787786318.290950:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6e00/0x450132973bff2117 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff211e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786318.290961:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6e00/0x450132973bff2117 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff211e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786318.291028:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686753792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787786318.291067:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786318.291104:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b522cc54d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787786318.291316:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686753792 00000100:00100000:3.0:1787786318.291322:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686753792 00000100:00100000:3.0:1787786318.291356:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787786318.291364:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:5843:x1874629686753792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787786318.291713:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:5843:x1874629686753792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 348us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786318.291723:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787786318.291974:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686753792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787786318.292023:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686753920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787786318.292095:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786318.292122:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b522cc54d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787786318.292631:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686753920 00000100:00100000:2.0:1787786318.292639:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686753920 00000100:00100000:2.0:1787786318.292690:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787786318.292700:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:5843:x1874629686753920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787786318.292953:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:5843:x1874629686753920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 253us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786318.292961:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787786318.293010:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360f0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686753920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787786318.299561:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c08b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8469:1874629686754048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787786318.299697:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786318.299766:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b521145ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787786318.299963:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686754048 00000100:00100000:0.0:1787786318.299973:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686754048 00000100:00100000:0.0:1787786318.300038:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1787786318.300050:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:8469:x1874629686754048:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787786318.300442:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:8469:x1874629686754048:12345-0@lo:502:llog_process_th.0 Request processed in 392us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786318.300453:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787786318.300732:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c08b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8469:1874629686754048:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787786318.300774:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787786318.300817:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786318.300821:0:8469:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787786318.300830:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787786318.300866:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5206350f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8469:1874629686754176:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787786318.300913:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786318.300946:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5208f500c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787786318.301022:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686754176 00000100:00100000:3.0:1787786318.301028:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686754176 00000100:00100000:3.0:1787786318.301074:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1787786318.301083:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:8469:x1874629686754176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787786318.302938:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:8469:x1874629686754176:12345-0@lo:502:llog_process_th.0 Request processed in 1845us (2013us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786318.302953:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787786318.303151:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5206350f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8469:1874629686754176:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787786318.303204:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787786318.303222:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786318.303225:0:8469:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787786318.303231:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1787786318.303725:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1787786318.303755:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787786318.303768:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6e00/0x450132973bff2117 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff211e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786318.303823:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6e00/0x450132973bff2117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff211e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786318.303836:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787786318.303839:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8b52090acd28 from 1 10000000:01000000:3.0:1787786318.303843:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787786318.303888:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6000/0x450132973bff2125 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786318.303898:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6000/0x450132973bff2125 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786318.303909:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6000/0x450132973bff2125 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786318.303936:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c0a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686754304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787786318.304002:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786318.304041:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b521145fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787786318.304181:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686754304 00000100:00100000:2.0:1787786318.304190:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686754304 00000100:00100000:2.0:1787786318.304252:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787786318.304263:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:5843:x1874629686754304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787786318.304283:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786318.304311:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b520151b000/0x450132973bff212c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff2125 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786318.304341:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b520151b000/0x450132973bff212c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff2125 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786318.304355:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b520151b000/0x450132973bff212c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff2125 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786318.304364:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520151b000, rc 0) 00000100:00100000:2.0:1787786318.304632:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:5843:x1874629686754304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 368us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786318.304640:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787786318.304960:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c0a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686754304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787786318.304978:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6000/0x450132973bff2125 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff212c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786318.304990:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6000/0x450132973bff2125 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff212c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786318.305066:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c0a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686754432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787786318.305099:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786318.305147:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b521145fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787786318.305245:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686754432 00000100:00100000:0.0:1787786318.305251:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686754432 00000100:00100000:0.0:1787786318.305304:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1787786318.305322:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:5843:x1874629686754432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787786318.305665:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:5843:x1874629686754432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 343us (564us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787786318.305673:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787786318.305899:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c0a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686754432:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787786318.305940:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787786318.305948:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6000/0x450132973bff2125 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff212c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786318.305958:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6000/0x450132973bff2125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff212c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786318.452012:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786318.452256:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667853056 00000100:00100000:2.0:1787786318.452269:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667853056 00000100:00100000:2.0:1787786318.452357:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 164 00000100:00100000:2.0:1787786318.452369:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+8:5620:x1874629667853056:12345-192.168.204.34@tcp:101: 00010000:00010000:2.0:1787786318.452401:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786318.452424:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b520151a200/0x450132973bff2133 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752133 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786318.452461:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b520151a200/0x450132973bff2133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752133 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786318.452496:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b520151a200/0x450132973bff2133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752133 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786318.452508:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520151a200, rc 0) 00000100:00100000:2.0:1787786318.452587:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+9:5620:x1874629667853056:12345-192.168.204.34@tcp:101: Request processed in 220us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786318.452595:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 164 00000100:00100000:3.0:1787786318.456170:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786318.457731:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667853184 00000100:00100000:2.0:1787786318.457755:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667853184 00000100:00100000:2.0:1787786318.457901:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 165 00000100:00100000:2.0:1787786318.457914:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+9:5620:x1874629667853184:12345-192.168.204.34@tcp:501: 00000100:00100000:2.0:1787786318.458316:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+9:5620:x1874629667853184:12345-192.168.204.34@tcp:501: Request processed in 404us (2289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786318.458325:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 165 00000100:00100000:1.0:1787786318.464774:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786318.464982:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667853312 00000100:00100000:0.0:1787786318.464997:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667853312 00000100:00100000:0.0:1787786318.465065:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 166 00000100:00100000:0.0:1787786318.465077:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+9:5620:x1874629667853312:12345-192.168.204.34@tcp:503: 00000100:00100000:0.0:1787786318.465435:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+9:5620:x1874629667853312:12345-192.168.204.34@tcp:503: Request processed in 359us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786318.465443:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 166 00000100:00100000:1.0:1787786318.470216:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786318.471035:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667853440 00000100:00100000:3.0:1787786318.471053:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667853440 00000100:00100000:3.0:1787786318.471135:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 167 00000100:00100000:3.0:1787786318.471148:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+9:6094:x1874629667853440:12345-192.168.204.34@tcp:502: 00000100:00100000:3.0:1787786318.472538:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+9:6094:x1874629667853440:12345-192.168.204.34@tcp:502: Request processed in 1252us (2199us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786318.472554:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 167 00000100:00100000:3.0:1787786318.481333:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786318.485494:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667853568 00000100:00100000:2.0:1787786318.485515:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667853568 00000100:00100000:2.0:1787786318.485604:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 168 00000100:00100000:2.0:1787786318.485617:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+9:6094:x1874629667853568:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787786318.486363:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+9:6094:x1874629667853568:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 741us (5038us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786318.486375:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 168 00000100:00100000:1.0:1787786318.490754:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786318.491911:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667853696 00000100:00100000:3.0:1787786318.491930:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667853696 00000100:00100000:2.0:1787786318.492260:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 169 00000100:00100000:2.0:1787786318.492274:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+9:5620:x1874629667853696:12345-192.168.204.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787786318.492310:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786318.492355:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b520151b400/0x450132973bff213a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75213a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786318.493124:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b520151b400/0x450132973bff213a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75213a expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786318.493143:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b520151b400/0x450132973bff213a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75213a expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786318.493154:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520151b400, rc 0) 00000100:00100000:2.0:1787786318.493251:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:5620:x1874629667853696:12345-192.168.204.34@tcp:101:ll_cfg_requeue.0 Request processed in 978us (2510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786318.493261:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 169 00000100:00100000:1.0:1787786318.496266:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786318.496356:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667853824 00000100:00100000:2.0:1787786318.496370:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667853824 00000100:00100000:2.0:1787786318.496557:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 170 00000100:00100000:2.0:1787786318.496570:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:5620:x1874629667853824:12345-192.168.204.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787786318.497069:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:5620:x1874629667853824:12345-192.168.204.34@tcp:501:ll_cfg_requeue.0 Request processed in 500us (815us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787786318.497080:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 170 00000100:00100000:3.0:1787786318.858261:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787786318.858306:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bf852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686754560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787786318.858420:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786318.858619:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686754560 00000100:00100000:0.0:1787786318.858631:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686754560 00000100:00100000:0.0:1787786318.858719:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787786318.858733:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c0a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686754560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787786318.858779:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787786318.858876:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c0a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686754560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786318.858884:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1787786318.858992:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787786318.859396:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bf852c0 x1874629686754560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786318.859422:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bf852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686754560:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787786319.306905:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787786319.829544:0:8506:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe20529980 20000000:00000080:2.0:1787786319.829568:0:8506:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8b52329bb400 uarg=0000000000000000 20000000:01000000:2.0:1787786319.829621:0:8506:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787786319.829629:0:8506:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787786319.829635:0:8506:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787786319.832528:0:8507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1787786319.832983:0:8506:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1787786319.851604:0:8506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1787786319.851674:0:8506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1787786319.851746:0:8506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1787786319.851783:0:8506:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787786319.851828:0:8506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b5201676600/0x450132973bff2141 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.851854:0:8506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b520151b200/0x450132973bff1eb6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1eaf expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.851864:0:8506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b5201677a00/0x450132973bff1f18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1f11 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.851872:0:8506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b520912d400/0x450132973bff1fe3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff1fdc expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.851884:0:8506:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b52421d5800/0x450132973bff20a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752102 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.851892:0:8506:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b5201676600/0x450132973bff2141 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.851980:0:8506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b52421d5800/0x450132973bff20a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752102 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.852001:0:8506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b52421d5800/0x450132973bff20a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752102 expref: 9 pid: 5840 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786319.852020:0:8506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1874629686754688:192.168.204.34@tcp:104: 00010000:00010000:1.0:1787786319.852170:0:8506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b520912d400/0x450132973bff1fe3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff1fdc expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.852179:0:8506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b520912d400/0x450132973bff1fe3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff1fdc expref: 18 pid: 5841 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786319.852188:0:8506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1874629686754816:0@lo:104: 00000100:00100000:1.0:1787786319.855355:0:8506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787786319.855468:0:8506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b5201677a00/0x450132973bff1f18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff1f11 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786319.855477:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686754816 00010000:00010000:1.0:1787786319.855485:0:8506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b5201677a00/0x450132973bff1f18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff1f11 expref: 18 pid: 5839 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786319.855487:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686754816 00000100:00100000:1.0:1787786319.855501:0:8506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1874629686754944:0@lo:104: 00000100:00100000:1.0:1787786319.855559:0:8506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786319.855560:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787786319.855571:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+3:8506:x1874629686754816:12345-0@lo:104: 00010000:00010000:0.0:1787786319.855589:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff1fdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1fe3 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.855595:0:8506:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b520151b200/0x450132973bff1eb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff1eaf expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.855604:0:8506:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b520151b200/0x450132973bff1eb6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff1eaf expref: 18 pid: 5840 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786319.855634:0:8506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360de00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1874629686755072:0@lo:104: 00010000:00010000:0.0:1787786319.855650:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787786319.855659:0:8506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786319.855662:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+3:8506:x1874629686754816:12345-0@lo:104: Request processed in 94us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786319.855672:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787786319.855674:0:8506:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5207397a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787786319.855689:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686754944 00000100:00100000:0.0:1787786319.855697:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686755072 00000100:00100000:0.0:1787786319.855703:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686755072 00000100:00100000:2.0:1787786319.855706:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686754944 00000100:00100000:1.0:1787786319.855706:0:8506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1874629686754688:192.168.204.34@tcp:104: 00000100:00100000:1.0:1787786319.855719:0:8506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360c3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1874629686754816:0@lo:104: 00000100:00100000:0.0:1787786319.855719:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1787786319.855731:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+3:8506:x1874629686755072:12345-0@lo:104: 00010000:00010000:0.0:1787786319.855739:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff8b5200030400/0x450132973bff1eaf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1eb6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.855765:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787786319.855772:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff1fdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1fe3 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.855782:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d4a00 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1787786319.855787:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff1fdc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff1fe3 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786319.855822:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787786319.855829:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+4:8506:x1874629686755072:12345-0@lo:104: Request processed in 103us (168us total) trans 0 rc 0/0 00010000:00010000:1.0:1787786319.855834:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff1fdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff1fe3 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786319.855838:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 10000000:00010000:1.0:1787786319.855842:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff1fdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff1fe3 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787786319.855849:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1787786319.855851:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787786319.855869:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4b7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+3:8506:x1874629686754944:12345-0@lo:104: 00010000:00010000:1.0:1787786319.855891:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff1fdc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1fe3 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786319.855892:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff8b52421d5c00/0x450132973bff1f11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1f18 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.855923:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787786319.855950:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff1fdc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1fe3 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.855959:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff1fdc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1fe3 expref: -99 pid: 7626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.855983:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787786319.855985:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786319.855988:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b5200030400/0x450132973bff1eaf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1eb6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.855994:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5200030400 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1787786319.855998:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b5200030400/0x450132973bff1eaf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff1eb6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.856005:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b5200030400/0x450132973bff1eaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff1eb6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787786319.856012:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b5200030400/0x450132973bff1eaf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff1eb6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786319.856016:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:01000000:1.0:1787786319.856019:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1787786319.856027:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4b7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+3:8506:x1874629686754944:12345-0@lo:104: Request processed in 163us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786319.856040:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1787786319.856047:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b5200030400/0x450132973bff1eaf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1eb6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786319.856050:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787786319.856056:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787786319.856058:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b52421d5c00/0x450132973bff1f11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff1f18 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786319.856066:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d5c00 already unused, calling callback (ffffffffc1be0c20) 00010000:00010000:1.0:1787786319.856066:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b5200030400/0x450132973bff1eaf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1eb6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787786319.856070:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b52421d5c00/0x450132973bff1f11 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff1f18 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.856074:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b5200030400/0x450132973bff1eaf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1eb6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.856089:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786319.856090:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b52421d5c00/0x450132973bff1f11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff1f18 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.856094:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786319.856097:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1787786319.856098:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b52421d5c00/0x450132973bff1f11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff1f18 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786319.856103:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787786319.856123:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b52421d5c00/0x450132973bff1f11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1f18 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786319.856124:0:8506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1874629686754944:0@lo:104: 00010000:00010000:3.0:1787786319.856129:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787786319.856143:0:8506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360de00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8506:1874629686755072:0@lo:104: 00010000:00010000:3.0:1787786319.856152:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b52421d5c00/0x450132973bff1f11 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1f18 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786319.856159:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686755328:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787786319.856163:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b52421d5c00/0x450132973bff1f11 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff1f18 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.856178:0:8506:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b5201676600/0x450132973bff2141 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786319.856185:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786319.856186:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786319.856188:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786319.856215:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686755456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787786319.856228:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786319.856497:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686755200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787786319.859226:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686755328 00000100:00100000:1.0:1787786319.859246:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686755328 00010000:00010000:1.0:1787786319.859323:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b520151b200/0x450132973bff1eb6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1eaf expref: 19 pid: 5840 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786319.859380:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787786319.859393:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206352d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3312:x1874629686755328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787786319.859416:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786319.859424:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b520151b200/0x450132973bff1eb6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1eaf expref: 19 pid: 5840 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.859438:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b520151b200/0x450132973bff1eb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff1eaf expref: 19 pid: 5840 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.859463:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b520151b200/0x450132973bff1eb6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff1eaf expref: 19 pid: 5840 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.859487:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787786319.860477:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786319.863699:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786319.863807:0:5831:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787786319.863818:0:5831:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1787786319.864620:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206352d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:3312:x1874629686755328:12345-0@lo:103:ldlm_bl.0 Request processed in 5223us (8386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786319.864638:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787786319.864675:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686755456 00000100:00100000:1.0:1787786319.864695:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686755456 00010000:00010000:1.0:1787786319.864741:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b5201677a00/0x450132973bff1f18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1f11 expref: 18 pid: 5839 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786319.864805:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686755200 00000100:00100000:1.0:1787786319.864810:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686755200 00010000:00010000:1.0:1787786319.864823:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b520912d400/0x450132973bff1fe3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1fdc expref: 19 pid: 5841 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786319.864839:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787786319.864849:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c09a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3313:x1874629686755456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787786319.864867:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786319.864873:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b5201677a00/0x450132973bff1f18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1f11 expref: 19 pid: 5839 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.864885:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b5201677a00/0x450132973bff1f18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff1f11 expref: 19 pid: 5839 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.864911:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5201677a00/0x450132973bff1f18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff1f11 expref: 19 pid: 5839 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.864932:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787786319.865104:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686755328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787786319.865531:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c09a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:3313:x1874629686755456:12345-0@lo:103:ldlm_bl.0 Request processed in 682us (5059us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786319.865538:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787786319.865556:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787786319.865566:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:3311:x1874629686755200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787786319.865576:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786319.865581:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b520912d400/0x450132973bff1fe3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff1fdc expref: 17 pid: 5841 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.865591:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b520912d400/0x450132973bff1fe3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff1fdc expref: 17 pid: 5841 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.865612:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b520912d400/0x450132973bff1fe3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff1fdc expref: 17 pid: 5841 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.865622:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786319.865664:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:3311:x1874629686755200:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (1975us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786319.865671:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787786319.866297:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686755200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787786319.867143:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686755456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787786319.867967:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786319.868152:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667853952 00000100:00100000:1.0:1787786319.868165:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667853952 00010000:00010000:1.0:1787786319.868215:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b52421d5800/0x450132973bff20a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752102 expref: 10 pid: 5840 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786319.868252:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 24 00000100:00100000:1.0:1787786319.868262:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52063530c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:2365:x1874629667853952:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787786319.868291:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786319.868298:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b52421d5800/0x450132973bff20a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752102 expref: 10 pid: 5840 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.868312:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b52421d5800/0x450132973bff20a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752102 expref: 10 pid: 5840 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.868337:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b52421d5800/0x450132973bff20a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752102 expref: 10 pid: 5840 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.868366:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b5201676600/0x450132973bff2141 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.868376:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5201676600/0x450132973bff2141 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.868416:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b5201676600/0x450132973bff2141 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.868423:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b5201676600/0x450132973bff2141 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.868431:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b5201676600/0x450132973bff2141 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.868438:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b5201676600/0x450132973bff2141 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.868445:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5201676600 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:1.0:1787786319.868450:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b5201676600/0x450132973bff2141 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.868460:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b5201676600/0x450132973bff2141 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.868484:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b5201676600/0x450132973bff2141 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786319.868498:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787786319.868512:0:8506:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b5201676600/0x450132973bff2141 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786319.868524:0:8506:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b5201676600/0x450132973bff2141 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786319.868543:0:8506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5201676600/0x450132973bff2141 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786319.868677:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52063530c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+9:2365:x1874629667853952:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 415us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786319.868688:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 24 00000100:00100000:2.0:1787786319.888361:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5206351680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874629686755968:0@lo:400:kworker.0 00000100:00100000:2.0:1787786319.888437:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786319.888480:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787786319.888487:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5206350780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686755584:0@lo:400:kworker.0 00000100:00100000:2.0:1787786319.888509:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786319.888528:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52063521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686756096:0@lo:400:kworker.0 00000100:00100000:2.0:1787786319.888550:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786319.889481:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686755968 00000100:00100000:2.0:1787786319.889492:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686755968 00000100:00100000:2.0:1787786319.889554:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686755584 00000100:00100000:2.0:1787786319.889557:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686755584 00000100:00100000:2.0:1787786319.889588:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787786319.889598:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206353840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874629686755968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786319.889677:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206353840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874629686755968:12345-0@lo:400:kworker.0 Request processed in 81us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786319.889708:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787786319.889733:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787786319.889743:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5206350f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874629686755712:0@lo:400:kworker.0 00000100:00100000:2.0:1787786319.889752:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206353c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686755584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786319.889848:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206353c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686755584:12345-0@lo:400:kworker.0 Request processed in 106us (1338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786319.889854:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787786319.889881:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686756096 00000100:00100000:2.0:1787786319.889886:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686756096 00000100:00100000:2.0:1787786319.889917:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787786319.889925:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206352940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686756096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786319.889963:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206352940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686756096:12345-0@lo:400:kworker.0 Request processed in 39us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786319.889973:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1787786319.889998:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787786319.890004:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787786319.890057:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5206350780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686755584:0@lo:400:kworker.0 00010000:00080000:2.0:1787786319.890076:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b52063521c0 x1874629686756096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786319.890089:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52063521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686756096:0@lo:400:kworker.0 00000100:00100000:2.0:1787786319.890102:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5206351680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874629686755968:0@lo:400:kworker.0 00000100:00100000:2.0:1787786319.890148:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5206352580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686755840:0@lo:400:kworker.0 00000100:00100000:1.0:1787786319.890220:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786319.890669:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786319.890732:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686755712 00000100:00100000:2.0:1787786319.890738:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686755712 00000100:00100000:2.0:1787786319.890825:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787786319.890835:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686755840 00000100:00100000:2.0:1787786319.890839:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874629686755712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786319.890857:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686755840 00000100:00100000:2.0:1787786319.890925:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874629686755712:12345-0@lo:400:kworker.0 Request processed in 90us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786319.890935:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787786319.890944:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787786319.890958:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206351680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686755840:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787786319.890988:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787786319.891029:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5206350f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874629686755712:0@lo:400:kworker.0 00000100:00100000:1.0:1787786319.891067:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206351680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686755840:12345-0@lo:400:kworker.0 Request processed in 116us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786319.891082:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1787786319.891098:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5206352580 x1874629686755840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786319.891114:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5206352580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686755840:0@lo:400:kworker.0 00000100:00100000:3.0:1787786320.313092:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786320.313221:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667854080 00000100:00100000:2.0:1787786320.313234:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667854080 00000100:00100000:2.0:1787786320.313332:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 171 00000100:00100000:2.0:1787786320.313345:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+9:5620:x1874629667854080:12345-192.168.204.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787786320.313369:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786320.313397:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5237aaca00/0x450132973bff2148 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752141 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786320.313446:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5237aaca00/0x450132973bff2148 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752141 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786320.313459:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5237aaca00/0x450132973bff2148 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752141 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786320.313469:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aaca00, rc 0) 00000100:00100000:2.0:1787786320.313549:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:5620:x1874629667854080:12345-192.168.204.34@tcp:101:ll_cfg_requeue.0 Request processed in 206us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786320.313579:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 171 00000100:00100000:0.0:1787786320.317418:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786320.317867:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667854208 00000100:00100000:2.0:1787786320.318023:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667854208 00000100:00100000:2.0:1787786320.318101:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 172 00000100:00100000:2.0:1787786320.318115:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:5620:x1874629667854208:12345-192.168.204.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787786320.319249:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:5620:x1874629667854208:12345-192.168.204.34@tcp:501:ll_cfg_requeue.0 Request processed in 1128us (1835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786320.319274:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 172 00000100:00100000:1.0:1787786320.328062:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786320.328222:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667854336 00000100:00100000:2.0:1787786320.328234:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667854336 00000100:00100000:2.0:1787786320.328362:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 173 00000100:00100000:2.0:1787786320.328377:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:5620:x1874629667854336:12345-192.168.204.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787786320.328702:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:5620:x1874629667854336:12345-192.168.204.34@tcp:503:ll_cfg_requeue.0 Request processed in 328us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786320.328713:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 173 00010000:00010000:3.0:1787786320.329957:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786320.340197:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786320.340428:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667854464 00000100:00100000:2.0:1787786320.340621:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667854464 00000100:00100000:2.0:1787786320.340695:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 174 00000100:00100000:2.0:1787786320.340709:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:6151:x1874629667854464:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787786320.341220:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:6151:x1874629667854464:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 511us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786320.341231:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 174 00000100:00100000:2.0:1787786320.346016:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786320.346130:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667854592 00000100:00100000:0.0:1787786320.346145:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667854592 00000100:00100000:0.0:1787786320.346218:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 175 00000100:00100000:0.0:1787786320.346230:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:6151:x1874629667854592:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787786320.346993:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:6151:x1874629667854592:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 760us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786320.347013:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 175 00000100:00100000:0.0:1787786320.394429:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bf87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686756224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787786320.394549:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786320.394671:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686756224 00000100:00100000:0.0:1787786320.394682:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686756224 00000100:00100000:0.0:1787786320.394754:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787786320.395414:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686756224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787786320.395464:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787786320.395587:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686756224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 181us (1038us total) trans 0 rc 0/0 00010000:00080000:3.0:1787786320.399725:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bf87c00 x1874629686756224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786320.399776:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bf87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686756224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787786320.403367:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1787786321.354479:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787786321.738908:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787786321.738920:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b5213768000 from 4 10000000:01000000:2.0:1787786321.738928:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787786321.739000:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b5237aad800/0x450132973bff214f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786321.739015:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b5237aad800/0x450132973bff214f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786321.739029:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b5237aad800/0x450132973bff214f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786321.739064:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5206352580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686756352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787786321.739178:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786321.739268:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5206328e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787786321.740473:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686756352 00000100:00100000:0.0:1787786321.740488:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686756352 00000100:00100000:0.0:1787786321.740561:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787786321.740574:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:5843:x1874629686756352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787786321.740596:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786321.740617:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b520912d200/0x450132973bff2156 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff214f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786321.740655:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b520912d200/0x450132973bff2156 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff214f expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786321.740668:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b520912d200/0x450132973bff2156 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff214f expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786321.740678:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912d200, rc 0) 00000100:00100000:0.0:1787786321.740775:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:5843:x1874629686756352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 204us (1597us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786321.740836:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1787786321.741440:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5206352580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686756352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787786321.741465:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b5237aad800/0x450132973bff214f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2156 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786321.741477:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b5237aad800/0x450132973bff214f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff2156 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786321.741573:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5206352580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686756480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787786321.741617:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786321.741661:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5206328e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787786321.742007:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686756480 00000100:00100000:1.0:1787786321.742014:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686756480 00000100:00100000:1.0:1787786321.742065:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1787786321.742075:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:5843:x1874629686756480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787786321.742416:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:5843:x1874629686756480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 342us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786321.742426:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787786321.744047:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5206352580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686756480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787786321.744134:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5206352580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686756608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787786321.744243:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786321.744306:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5206328e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787786321.744465:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686756608 00000100:00100000:0.0:1787786321.744475:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686756608 00000100:00100000:0.0:1787786321.744539:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787786321.744550:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:5843:x1874629686756608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787786321.744994:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:5843:x1874629686756608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 444us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786321.745004:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787786321.753909:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5206352580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686756608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787786321.754693:0:8577:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5206350f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8577:1874629686756736:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787786321.754835:0:8577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786321.754893:0:8577:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5206328b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787786321.754968:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686756736 00000100:00100000:3.0:1787786321.754978:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686756736 00000100:00100000:3.0:1787786321.755042:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787786321.755053:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:8577:x1874629686756736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787786321.755344:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:8577:x1874629686756736:12345-0@lo:502:llog_process_th.0 Request processed in 292us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786321.755354:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787786321.755925:0:8577:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5206350f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8577:1874629686756736:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787786321.755961:0:8577:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787786321.755973:0:8577:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786321.755977:0:8577:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787786321.755984:0:8577:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b5213768000 00000020:00000080:2.0:1787786321.755986:0:8577:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787786321.756084:0:8577:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5206350f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8577:1874629686756864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787786321.756134:0:8577:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786321.756163:0:8577:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5206328b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787786321.758425:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686756864 00000100:00100000:0.0:1787786321.758444:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686756864 00000100:00100000:0.0:1787786321.758517:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787786321.758528:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:8577:x1874629686756864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787786321.758889:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:8577:x1874629686756864:12345-0@lo:502:llog_process_th.0 Request processed in 361us (2752us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786321.758898:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787786321.759324:0:8577:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5206350f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8577:1874629686756864:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787786321.759369:0:8577:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787786321.759381:0:8577:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786321.759384:0:8577:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1787786321.759388:0:8577:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787786321.762409:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787786321.762471:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787786321.762486:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b5237aad800/0x450132973bff214f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2156 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786321.762503:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b5237aad800/0x450132973bff214f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2156 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786321.762517:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787786321.762530:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b5206233000 from 4 10000000:01000000:3.0:1787786321.762534:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787786321.762590:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6600/0x450132973bff215d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786321.762599:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6600/0x450132973bff215d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786321.762614:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6600/0x450132973bff215d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786321.762660:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c092c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686756992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787786321.762768:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786321.762868:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b446840 going to sleep for 11 seconds 00000100:00100000:3.0:1787786321.762901:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686756992 00000100:00100000:3.0:1787786321.762911:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686756992 00000100:00100000:3.0:1787786321.762979:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787786321.762991:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:5843:x1874629686756992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787786321.763011:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786321.763029:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b523bcb7800/0x450132973bff2164 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff215d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786321.763061:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b523bcb7800/0x450132973bff2164 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff215d expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786321.763074:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b523bcb7800/0x450132973bff2164 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff215d expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786321.763085:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb7800, rc 0) 00000100:00100000:3.0:1787786321.763132:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:5843:x1874629686756992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786321.763146:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787786321.763202:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c092c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686756992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787786321.763218:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6600/0x450132973bff215d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2164 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786321.763239:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6600/0x450132973bff215d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff2164 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786321.763299:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c092c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686757120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787786321.763328:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786321.763344:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b446840 going to sleep for 11 seconds 00000100:00100000:3.0:1787786321.763359:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686757120 00000100:00100000:3.0:1787786321.763362:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686757120 00000100:00100000:3.0:1787786321.763385:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787786321.763391:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:5843:x1874629686757120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787786321.763709:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:5843:x1874629686757120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 316us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786321.763717:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787786321.763749:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c092c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686757120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787786321.763782:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c092c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686757248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787786321.763851:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786321.763867:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b446840 going to sleep for 11 seconds 00000100:00100000:3.0:1787786321.763881:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686757248 00000100:00100000:3.0:1787786321.763885:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686757248 00000100:00100000:3.0:1787786321.763909:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787786321.763922:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:5843:x1874629686757248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787786321.764093:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:5843:x1874629686757248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786321.764101:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787786321.764142:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c092c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686757248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787786321.764385:0:8579:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c092c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8579:1874629686757376:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787786321.764424:0:8579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786321.764445:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686757376 00000100:00100000:3.0:1787786321.764449:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686757376 00000100:00100000:3.0:1787786321.764470:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787786321.764476:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:8579:x1874629686757376:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787786321.764607:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:8579:x1874629686757376:12345-0@lo:502:llog_process_th.0 Request processed in 131us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786321.764615:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787786321.764644:0:8579:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b446600 going to sleep for 11 seconds 00000100:00100000:3.0:1787786321.764657:0:8579:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c092c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8579:1874629686757376:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787786321.764683:0:8579:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787786321.764694:0:8579:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787786321.764697:0:8579:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787786321.764705:0:8579:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b5206233000 00000020:00000080:3.0:1787786321.764708:0:8579:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787786321.764819:0:8579:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c092c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8579:1874629686757504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787786321.764853:0:8579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786321.764876:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686757504 00000100:00100000:3.0:1787786321.764879:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686757504 00000100:00100000:3.0:1787786321.764910:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787786321.764916:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:8579:x1874629686757504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787786321.765027:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:8579:x1874629686757504:12345-0@lo:502:llog_process_th.0 Request processed in 111us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786321.765035:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787786321.765064:0:8579:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b446600 going to sleep for 11 seconds 00000100:00100000:3.0:1787786321.765076:0:8579:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c092c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8579:1874629686757504:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787786321.765096:0:8579:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787786321.765100:0:8579:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787786321.765101:0:8579:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787786321.765105:0:8579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787786321.765173:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787786321.765197:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787786321.765208:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6600/0x450132973bff215d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2164 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786321.783886:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6600/0x450132973bff215d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2164 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786321.783908:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787786321.783912:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b5207b73000 from 4 10000000:01000000:3.0:1787786321.783916:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787786321.783983:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7a00/0x450132973bff216b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786321.783993:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7a00/0x450132973bff216b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786321.784006:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7a00/0x450132973bff216b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786321.784048:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c092c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686757632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787786321.784143:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786321.784272:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b446600 going to sleep for 11 seconds 00000100:00100000:2.0:1787786321.787524:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686757632 00000100:00100000:2.0:1787786321.787541:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686757632 00000100:00100000:2.0:1787786321.787624:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1787786321.787813:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:5843:x1874629686757632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787786321.787840:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786321.787869:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5237aada00/0x450132973bff2172 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff216b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786321.787908:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5237aada00/0x450132973bff2172 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff216b expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786321.787945:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5237aada00/0x450132973bff2172 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff216b expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786321.787957:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aada00, rc 0) 00000100:00100000:2.0:1787786321.788093:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:5843:x1874629686757632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 381us (3949us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786321.788102:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787786321.789893:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c092c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686757632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787786321.789931:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7a00/0x450132973bff216b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2172 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786321.789945:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7a00/0x450132973bff216b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff2172 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786321.790060:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c092c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686757760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787786321.790132:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786321.790180:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686757760 00000100:00100000:3.0:1787786321.790186:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686757760 00000100:00100000:3.0:1787786321.790251:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787786321.790262:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:5843:x1874629686757760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787786321.790588:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:5843:x1874629686757760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 326us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786321.790597:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787786321.791850:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b446600 going to sleep for 11 seconds 00000100:00100000:3.0:1787786321.791894:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c092c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686757760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787786321.791965:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c092c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686757888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787786321.792042:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786321.792075:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b446600 going to sleep for 11 seconds 00000100:00100000:2.0:1787786321.796113:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686757888 00000100:00100000:2.0:1787786321.796133:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686757888 00000100:00100000:2.0:1787786321.796214:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1787786321.796225:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:5843:x1874629686757888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787786321.796566:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:5843:x1874629686757888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 341us (4523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786321.796576:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787786321.798025:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c092c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686757888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787786321.806939:0:8581:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c092c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8581:1874629686758016:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787786321.807063:0:8581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786321.807120:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686758016 00000100:00100000:3.0:1787786321.807128:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686758016 00000100:00100000:3.0:1787786321.807187:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787786321.807198:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:8581:x1874629686758016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787786321.807473:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:8581:x1874629686758016:12345-0@lo:502:llog_process_th.0 Request processed in 275us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786321.807482:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1787786321.807539:0:8581:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b446cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787786321.807563:0:8581:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c092c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8581:1874629686758016:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787786321.807597:0:8581:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787786321.807607:0:8581:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787786321.807610:0:8581:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787786321.807618:0:8581:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b5207b73000 00000020:00000080:3.0:1787786321.807620:0:8581:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787786321.810935:0:8581:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c092c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8581:1874629686758144:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787786321.811043:0:8581:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786321.811086:0:8581:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b446cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787786321.814877:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686758144 00000100:00100000:1.0:1787786321.814901:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686758144 00000100:00100000:1.0:1787786321.814984:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787786321.814997:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:8581:x1874629686758144:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787786321.815334:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:8581:x1874629686758144:12345-0@lo:502:llog_process_th.0 Request processed in 339us (4290us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786321.815342:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787786321.815868:0:8581:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c092c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:8581:1874629686758144:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787786321.815923:0:8581:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787786321.815934:0:8581:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787786321.815937:0:8581:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787786321.815943:0:8581:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787786321.816041:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787786321.816075:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787786321.816088:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7a00/0x450132973bff216b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2172 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786321.816101:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7a00/0x450132973bff216b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2172 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786322.378966:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786322.875751:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786322.875861:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786322.875895:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786322.875930:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786322.875977:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667854976 00000100:00100000:0.0:1787786322.876147:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667854848 00000100:00100000:0.0:1787786322.876160:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667854848 00000100:00100000:0.0:1787786322.876261:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 30 00000100:00100000:0.0:1787786322.876274:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+6:2363:x1874629667854848:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1787786322.876395:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+6:2363:x1874629667854848:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 124us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786322.876403:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 30 00000100:00100000:3.0:1787786322.876753:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667854720 00000100:00100000:3.0:1787786322.876760:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667854720 00000100:00100000:3.0:1787786322.876830:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 191 00000100:00100000:3.0:1787786322.876839:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:2363:x1874629667854720:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1787786322.876882:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:2363:x1874629667854720:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 46us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786322.876889:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 191 00000100:00100000:2.0:1787786322.877594:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667855104 00000100:00100000:2.0:1787786322.877604:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667855104 00000100:00100000:2.0:1787786322.877669:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 15 00000100:00100000:2.0:1787786322.877683:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:173d08e0-0e54-474e-858e-1679cd38cf14+5:2363:x1874629667855104:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786322.877739:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:173d08e0-0e54-474e-858e-1679cd38cf14+5:2363:x1874629667855104:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 62us (1808us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786322.877746:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 15 00000100:00080000:2.0:1787786322.877772:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787786322.877777:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787786322.877971:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667854976 00000100:00100000:1.0:1787786322.879275:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 16 00000100:00100000:1.0:1787786322.879295:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:173d08e0-0e54-474e-858e-1679cd38cf14+5:2363:x1874629667854976:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1787786322.879709:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:173d08e0-0e54-474e-858e-1679cd38cf14+5:2363:x1874629667854976:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 420us (3846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786322.879719:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 16 00000100:00080000:2.0:1787786322.880245:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787786323.403311:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786323.978064:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787786323.978096:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bf87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686758272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787786323.978217:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786323.978372:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686758272 00000100:00100000:0.0:1787786323.978382:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686758272 00000100:00100000:0.0:1787786323.978467:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787786323.978478:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686758272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787786323.978537:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787786323.978593:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c092c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686758272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786323.978601:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1787786323.978693:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787786323.978738:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bf87840 x1874629686758272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786323.978760:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bf87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686758272:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787786324.426171:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786325.002300:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bf861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686758400:0@lo:400:kworker.0 00000100:00100000:2.0:1787786325.002390:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786325.003644:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686758400 00000100:00100000:1.0:1787786325.003664:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686758400 00000100:00100000:1.0:1787786325.003719:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787786325.003732:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52063f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3313:x1874629686758400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786325.008843:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52063f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3313:x1874629686758400:12345-0@lo:400:kworker.0 Request processed in 5107us (6446us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786325.008858:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1787786325.008904:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bf87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686758784:0@lo:400:kworker.0 00000100:00100000:1.0:1787786325.008959:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786325.008990:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787786325.008996:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bf87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874629686758656:0@lo:400:kworker.0 00000100:00100000:1.0:1787786325.009021:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786325.012345:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686758784 00000100:00100000:1.0:1787786325.012360:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686758784 00000100:00100000:1.0:1787786325.012440:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787786325.012452:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686758784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786325.012547:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686758784:12345-0@lo:400:kworker.0 Request processed in 98us (3586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786325.012555:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787786325.012599:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bf85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686758528:0@lo:400:kworker.0 00000100:00100000:1.0:1787786325.012633:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786325.013222:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bf852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686759040:0@lo:400:kworker.0 00000100:00100000:1.0:1787786325.013252:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786325.013284:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787786325.013292:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bf85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874629686758912:0@lo:400:kworker.0 00000100:00100000:1.0:1787786325.013313:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787786325.013336:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787786325.013370:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bf87c00 x1874629686758784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786325.013389:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bf87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686758784:0@lo:400:kworker.0 00000100:00100000:0.0:1787786325.013489:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686759040 00000100:00100000:0.0:1787786325.013494:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686759040 00000100:00100000:0.0:1787786325.013535:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787786325.013544:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686759040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786325.014448:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686758656 00000100:00100000:3.0:1787786325.014456:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686758656 00000100:00100000:3.0:1787786325.014498:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686758528 00000100:00100000:3.0:1787786325.014501:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686758528 00000100:00100000:3.0:1787786325.014512:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686758912 00000100:00100000:3.0:1787786325.014522:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686758912 00000100:00100000:3.0:1787786325.014542:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787786325.014550:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874629686758656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786325.014823:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bf861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686758400:0@lo:400:kworker.0 00000100:00100000:2.0:1787786325.014856:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787786325.014864:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686758528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786325.014954:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686759040:12345-0@lo:400:kworker.0 Request processed in 1410us (1699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786325.014964:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787786325.014991:0:5847:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1787786325.014999:0:5847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:0.0:1787786325.015014:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787786325.015018:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787786325.016528:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686758528:12345-0@lo:400:kworker.0 Request processed in 1657us (3885us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786325.016543:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787786325.016578:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787786325.016593:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874629686758912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786325.016665:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874629686758912:12345-0@lo:400:kworker.0 Request processed in 67us (3338us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786325.016671:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787786325.019572:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bf85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874629686758912:0@lo:400:kworker.0 00000100:00100000:1.0:1787786325.019591:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bf85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686758528:0@lo:400:kworker.0 00010000:00080000:1.0:1787786325.019608:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bf852c0 x1874629686759040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786325.019620:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bf852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686759040:0@lo:400:kworker.0 00000100:00100000:3.0:1787786325.020004:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874629686758656:12345-0@lo:400:kworker.0 Request processed in 5450us (10977us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786325.020016:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787786325.027356:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bf87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874629686758656:0@lo:400:kworker.0 00010000:00010000:3.0:1787786325.451485:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786325.515036:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787786325.515061:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bf87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686759168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787786325.515145:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786325.518073:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686759168 00000100:00100000:0.0:1787786325.518092:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686759168 00000100:00100000:2.0:1787786325.519638:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787786325.519654:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103b78f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686759168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787786325.519700:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787786325.519813:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103b78f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686759168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 164us (4667us total) trans 0 rc 0/0 00010000:00080000:1.0:1787786325.520134:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bf87840 x1874629686759168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786341 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786325.520167:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bf87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686759168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787786325.522485:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000001:02000400:0.0:1787786326.466251:0:8809:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg434-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1787786326.474250:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786327.501676:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786327.988177:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786327.988246:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786327.988277:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786327.988330:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786327.988338:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667855232 00000100:00100000:1.0:1787786327.988354:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667855232 00000100:00100000:0.0:1787786327.988370:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667855488 00000100:00100000:0.0:1787786327.988379:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667855488 00000100:00100000:0.0:1787786327.988474:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667855616 00000100:00100000:0.0:1787786327.988480:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667855616 00000100:00100000:1.0:1787786327.988494:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 193 00000100:00100000:1.0:1787786327.988510:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52063f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:2364:x1874629667855232:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1787786327.988522:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 19 00000100:00100000:0.0:1787786327.988535:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+5:2364:x1874629667855488:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1787786327.988618:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52063f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:2364:x1874629667855232:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 111us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786327.988631:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+5:2364:x1874629667855488:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 97us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786327.988639:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 193 00000100:00100000:0.0:1787786327.988650:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 19 00000100:00100000:0.0:1787786327.988676:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 20 00000100:00100000:0.0:1787786327.988684:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+5:2364:x1874629667855616:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1787786327.988717:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+5:2364:x1874629667855616:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 35us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786327.988723:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 20 00000100:00080000:1.0:1787786327.988765:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787786327.988774:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787786327.989016:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667855360 00000100:00100000:3.0:1787786327.989039:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667855360 00000100:00100000:2.0:1787786327.989606:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 34 00000100:00100000:2.0:1787786327.989622:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+6:2364:x1874629667855360:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786327.989685:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+6:2364:x1874629667855360:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 70us (1407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786327.989692:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 34 00000100:00080000:1.0:1787786327.992852:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787786328.522346:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786329.098861:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bf861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686759296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787786329.098940:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786329.099139:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686759296 00000100:00100000:0.0:1787786329.099149:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686759296 00000100:00100000:0.0:1787786329.099222:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787786329.099232:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c08f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686759296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787786329.099268:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787786329.099321:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c08f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686759296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786329.099328:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1787786329.099661:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787786329.099694:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bf861c0 x1874629686759296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786345 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786329.099729:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bf861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686759296:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787786329.545913:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786330.124843:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b79680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686759552:0@lo:400:kworker.0 00000100:00100000:1.0:1787786330.124921:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786330.124981:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686760064:0@lo:400:kworker.0 00000100:00100000:1.0:1787786330.125007:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786330.125039:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787786330.125045:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b7a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3314:1874629686759424:0@lo:400:kworker.0 00000100:00100000:1.0:1787786330.125084:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786330.125107:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874629686759936:0@lo:400:kworker.0 00000100:00100000:1.0:1787786330.125129:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786330.125218:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874629686759680:0@lo:400:kworker.0 00000100:00100000:1.0:1787786330.125243:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786330.125264:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787786330.125270:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686759808:0@lo:400:kworker.0 00000100:00100000:1.0:1787786330.125297:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786330.125331:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686759552 00000100:00100000:1.0:1787786330.125338:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686759552 00000100:00100000:1.0:1787786330.125383:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686759936 00000100:00100000:1.0:1787786330.125386:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686759936 00000100:00100000:0.0:1787786330.125425:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686759680 00000100:00100000:0.0:1787786330.125429:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686759680 00000100:00100000:1.0:1787786330.125434:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787786330.125441:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103b79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686759552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786330.125449:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787786330.125455:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874629686759936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786330.125492:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103b79a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686759552:12345-0@lo:400:kworker.0 Request processed in 50us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786330.125499:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787786330.125553:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787786330.125572:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103b783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874629686759680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786330.125627:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103b783c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874629686759680:12345-0@lo:400:kworker.0 Request processed in 60us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786330.125633:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787786330.125658:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686760064 00000100:00100000:2.0:1787786330.125661:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686760064 00000100:00100000:2.0:1787786330.125690:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686759808 00000100:00100000:2.0:1787786330.125692:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686759808 00000100:00100000:2.0:1787786330.125712:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787786330.125719:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103b78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686760064:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787786330.125760:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787786330.125765:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787786330.126352:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103b7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874629686759936:12345-0@lo:400:kworker.0 Request processed in 894us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786330.126360:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787786330.126532:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103b78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686760064:12345-0@lo:400:kworker.0 Request processed in 812us (1522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786330.126540:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787786330.126562:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787786330.126573:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103b79e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686759808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786330.126625:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103b79e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686759808:12345-0@lo:400:kworker.0 Request processed in 57us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786330.126631:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787786330.126659:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686759424 00000100:00100000:2.0:1787786330.126664:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686759424 00000100:00100000:2.0:1787786330.126699:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787786330.126706:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3314:x1874629686759424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786330.126739:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3314:x1874629686759424:12345-0@lo:400:kworker.0 Request processed in 33us (1653us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786330.126745:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787786330.130052:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874629686759936:0@lo:400:kworker.0 00000100:00100000:1.0:1787786330.130084:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b79680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686759552:0@lo:400:kworker.0 00010000:00080000:1.0:1787786330.130100:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5103b7a940 x1874629686760064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786330.130111:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b7a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686760064:0@lo:400:kworker.0 00000100:00100000:1.0:1787786330.130157:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b7a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3314:1874629686759424:0@lo:400:kworker.0 00010000:00080000:1.0:1787786330.130242:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5103b7b840 x1874629686759808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786330.130253:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686759808:0@lo:400:kworker.0 00000100:00100000:1.0:1787786330.130265:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b7a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874629686759680:0@lo:400:kworker.0 00010000:00010000:0.0:1787786330.569994:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786330.634816:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787786330.634851:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bf87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686760192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787786330.634926:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786330.635010:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686760192 00000100:00100000:0.0:1787786330.635020:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686760192 00000100:00100000:0.0:1787786330.635082:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787786330.635092:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686760192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787786330.635145:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787786330.635193:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686760192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786330.635201:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1787786330.635251:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bf87c00 x1874629686760192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786346 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786330.635271:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bf87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686760192:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1787786331.558658:0:9053:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg434-server.virtnet: executing yml_node 00010000:00010000:3.0:1787786331.594000:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786332.620739:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786333.118189:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786333.122039:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786333.122118:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786333.122137:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667855872 00000100:00100000:3.0:1787786333.122150:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667855872 00000100:00100000:3.0:1787786333.122230:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 38 00000100:00100000:3.0:1787786333.122250:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206350780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+6:2363:x1874629667855872:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786333.122266:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786333.122336:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667855744 00000100:00100000:3.0:1787786333.122338:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206350780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+6:2363:x1874629667855872:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 100us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786333.122340:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667855744 00000100:00100000:3.0:1787786333.122347:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 38 00000100:00080000:1.0:1787786333.122351:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787786333.122385:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 195 00000100:00100000:1.0:1787786333.126592:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:2363:x1874629667855744:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1787786333.126707:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:2363:x1874629667855744:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 4315us (8529us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786333.126730:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 195 00000100:00100000:0.0:1787786333.129316:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667856000 00000100:00100000:0.0:1787786333.129332:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667856000 00000100:00100000:0.0:1787786333.129410:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667856128 00000100:00100000:0.0:1787786333.129414:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667856128 00000100:00100000:0.0:1787786333.129454:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00100000:0.0:1787786333.129464:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206351a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+5:2361:x1874629667856000:12345-192.168.204.34@tcp:9:kworker.0 00000100:00100000:3.0:1787786333.129478:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 11 00000100:00100000:3.0:1787786333.129486:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+5:2361:x1874629667856128:12345-192.168.204.34@tcp:9:kworker.0 00000020:00000080:0.0:1787786333.129500:0:6699:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff20ae 00000100:00080000:0.0:1787786333.129511:0:6699:0:(import.c:65:import_set_state_nolock()) ffff8b5237bbc800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1787786333.129513:0:8126:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff20b5 00000100:00080000:3.0:1787786333.129520:0:8126:0:(import.c:65:import_set_state_nolock()) ffff8b523b44c800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787786333.129548:0:8126:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787786333.129930:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+2:2361:x1874629667856128:12345-192.168.204.34@tcp:9:kworker.0 Request processed in 443us (7661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786333.129939:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 11 00010000:00010000:3.0:1787786333.129963:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786333.130044:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787786333.130047:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787786333.130051:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:0.0:1787786333.130327:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787786333.130651:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206351a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+2:2361:x1874629667856000:12345-192.168.204.34@tcp:9:kworker.0 Request processed in 1187us (8530us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786333.130660:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 10 00010000:00010000:3.0:1787786333.641969:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786334.224719:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bf87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686760320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787786334.224829:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786334.225067:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686760320 00000100:00100000:0.0:1787786334.225089:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686760320 00000100:00100000:0.0:1787786334.225160:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787786334.225170:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686760320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787786334.225207:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787786334.225307:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686760320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786334.225315:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787786334.225374:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787786334.235766:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bf87c00 x1874629686760320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786334.235825:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bf87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686760320:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787786334.665994:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786335.243236:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686760576:0@lo:400:kworker.0 00000100:00100000:3.0:1787786335.243308:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786335.243363:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686761088:0@lo:400:kworker.0 00000100:00100000:3.0:1787786335.243389:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786335.243415:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874629686760704:0@lo:400:kworker.0 00000100:00100000:3.0:1787786335.243421:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787786335.243426:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3314:1874629686760448:0@lo:400:kworker.0 00000100:00100000:0.0:1787786335.243444:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786335.243450:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786335.243471:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc9bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874629686760960:0@lo:400:kworker.0 00000100:00100000:0.0:1787786335.243476:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787786335.243480:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc98780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686760832:0@lo:400:kworker.0 00000100:00100000:3.0:1787786335.243492:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786335.243498:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786335.243518:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686760576 00000100:00100000:0.0:1787786335.243518:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686760704 00000100:00100000:0.0:1787786335.243524:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686760704 00000100:00100000:3.0:1787786335.243526:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686760576 00000100:00100000:0.0:1787786335.243570:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686760960 00000100:00100000:0.0:1787786335.243574:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686760960 00000100:00100000:2.0:1787786335.243629:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1787786335.243652:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787786335.245233:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787786335.245242:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686760576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786335.245316:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc9b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686760576:12345-0@lo:400:kworker.0 Request processed in 75us (2008us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786335.245323:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787786335.245351:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686760448 00000100:00100000:3.0:1787786335.245356:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686760448 00000100:00100000:3.0:1787786335.245381:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787786335.245387:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3314:x1874629686760448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786335.245418:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3314:x1874629686760448:12345-0@lo:400:kworker.0 Request processed in 31us (1966us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786335.245424:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787786335.248676:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686761088 00000100:00100000:3.0:1787786335.248695:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686761088 00000100:00100000:3.0:1787786335.248776:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686760832 00000100:00100000:3.0:1787786335.248779:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686760832 00000100:00100000:3.0:1787786335.248827:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787786335.248837:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc9b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686761088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786335.248923:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc9b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686761088:12345-0@lo:400:kworker.0 Request processed in 88us (5533us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786335.248930:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787786335.248946:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787786335.248951:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686760832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786335.248996:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686760832:12345-0@lo:400:kworker.0 Request processed in 45us (5496us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786335.249002:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1787786335.249083:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bc98780 x1874629686760832/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786335.249096:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc98780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686760832:0@lo:400:kworker.0 00000100:00100000:3.0:1787786335.249137:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3314:1874629686760448:0@lo:400:kworker.0 00000100:00100000:3.0:1787786335.249151:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686760576:0@lo:400:kworker.0 00010000:00080000:3.0:1787786335.249160:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bc98000 x1874629686761088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786335.249169:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686761088:0@lo:400:kworker.0 00000100:00100000:0.0:1787786335.250847:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787786335.250860:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874629686760960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786335.250950:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc9ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874629686760960:12345-0@lo:400:kworker.0 Request processed in 93us (7457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786335.250959:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787786335.251019:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc9bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874629686760960:0@lo:400:kworker.0 00000100:00100000:2.0:1787786335.251524:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874629686760704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786335.251573:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874629686760704:12345-0@lo:400:kworker.0 Request processed in 7936us (8128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786335.251580:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787786335.252934:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874629686760704:0@lo:400:kworker.0 00000100:00080000:1.0:1787786335.258598:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1787786335.277016:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 173d08e0-0e54-474e-858e-1679cd38cf14 00000020:00000080:3.0:1787786335.277025:0:6723:0:(genops.c:885:class_export_put()) final put ffff8b5237bbd000/173d08e0-0e54-474e-858e-1679cd38cf14 00000020:00000080:1.0:1787786335.277164:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5237bbd000/173d08e0-0e54-474e-858e-1679cd38cf14 for lustre-OST0000 00000020:00000080:1.0:1787786335.277218:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5237bbc800 for lustre-OST0000 00010000:00010000:0.0:1787786335.696286:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786335.754172:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686761216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787786335.754248:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786335.754357:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686761216 00000100:00100000:0.0:1787786335.754364:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686761216 00000100:00100000:0.0:1787786335.754420:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787786335.754442:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686761216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787786335.754488:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787786335.754540:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686761216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786335.754547:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1787786335.754731:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bc4f0c0 x1874629686761216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786351 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786335.754751:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686761216:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1787786335.974234:0:9246:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.53 00010000:00010000:3.0:1787786336.714113:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787786337.371739:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 173d08e0-0e54-474e-858e-1679cd38cf14 00000020:00000080:2.0:1787786337.371748:0:7647:0:(genops.c:885:class_export_put()) final put ffff8b523b448000/173d08e0-0e54-474e-858e-1679cd38cf14 00000020:00000080:1.0:1787786337.371848:0:481:0:(genops.c:844:class_export_destroy()) destroying export ffff8b523b448000/173d08e0-0e54-474e-858e-1679cd38cf14 for lustre-OST0001 00000020:00000080:1.0:1787786337.371962:0:481:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b523b44c800 for lustre-OST0001 00010000:00010000:1.0:1787786337.741550:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786338.233494:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786338.233597:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786338.233725:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667856256 00000100:00100000:1.0:1787786338.233737:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667856256 00000100:00100000:1.0:1787786338.233875:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 197 00000100:00100000:1.0:1787786338.233886:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:2363:x1874629667856256:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1787786338.233972:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:2363:x1874629667856256:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 87us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786338.233980:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 197 00000100:00100000:3.0:1787786338.234119:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667856384 00000100:00100000:3.0:1787786338.234125:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667856384 00000100:00100000:3.0:1787786338.234181:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 42 00000100:00100000:3.0:1787786338.234189:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52063503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+6:2362:x1874629667856384:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1787786338.234222:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52063503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+6:2362:x1874629667856384:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 34us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786338.234229:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 42 00000100:00080000:1.0:1787786338.238967:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:2.0:1787786338.400401:0:9345:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.53 00010000:00010000:0.0:1787786338.768059:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786339.338996:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787786339.339022:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc9a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686761344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787786339.339092:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786339.339159:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686761344 00000100:00100000:3.0:1787786339.339167:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686761344 00000100:00100000:3.0:1787786339.339235:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787786339.339244:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc9a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686761344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787786339.339280:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787786339.339329:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc9a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686761344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786339.339337:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1787786339.339380:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bc9a580 x1874629686761344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786339.339400:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc9a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686761344:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787786339.339651:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787786339.787785:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786340.363988:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686761472:0@lo:400:kworker.0 00000100:00100000:0.0:1787786340.364016:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686761600:0@lo:400:kworker.0 00000100:00100000:0.0:1787786340.364071:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786340.364072:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786340.364241:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc4f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686761856:0@lo:400:kworker.0 00000100:00100000:2.0:1787786340.366659:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc4fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874629686761984:0@lo:400:kworker.0 00000100:00100000:2.0:1787786340.366718:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786340.366729:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686761472 00000100:00100000:3.0:1787786340.366738:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686761472 00000100:00100000:3.0:1787786340.366813:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787786340.366823:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3313:x1874629686761472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786340.366895:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3313:x1874629686761472:12345-0@lo:400:kworker.0 Request processed in 73us (2825us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786340.366902:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1787786340.367063:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686762112:0@lo:400:kworker.0 00000100:00100000:0.0:1787786340.367100:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786340.367136:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686761600 00000100:00100000:0.0:1787786340.367140:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686761600 00000100:00100000:0.0:1787786340.367175:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686761984 00000100:00100000:0.0:1787786340.367178:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686761984 00000100:00100000:2.0:1787786340.367285:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787786340.367297:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686761600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786340.367339:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686761600:12345-0@lo:400:kworker.0 Request processed in 47us (3271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786340.367347:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787786340.367403:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787786340.367432:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206351e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874629686761984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786340.367478:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206351e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874629686761984:12345-0@lo:400:kworker.0 Request processed in 69us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786340.367484:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787786340.367753:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc4fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874629686761984:0@lo:400:kworker.0 00000100:00100000:2.0:1787786340.367763:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686761472:0@lo:400:kworker.0 00000100:00080000:2.0:1787786340.367844:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787786340.367856:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874629686761728:0@lo:400:kworker.0 00000100:00100000:2.0:1787786340.367897:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786340.368558:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686761728 00000100:00100000:0.0:1787786340.368567:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686761728 00000100:00100000:0.0:1787786340.368619:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787786340.368633:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52063512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874629686761728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786340.368693:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52063512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874629686761728:12345-0@lo:400:kworker.0 Request processed in 67us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786340.368704:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787786340.368746:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc4e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874629686761728:0@lo:400:kworker.0 00000100:00100000:0.0:1787786340.368782:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686761600:0@lo:400:kworker.0 00000100:00100000:3.0:1787786340.368880:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686762112 00000100:00100000:3.0:1787786340.368885:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686762112 00000100:00100000:3.0:1787786340.368929:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787786340.368936:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686762112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786340.368947:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786340.368983:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686761856 00000100:00100000:1.0:1787786340.368987:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686761856 00000100:00100000:3.0:1787786340.369000:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686762112:12345-0@lo:400:kworker.0 Request processed in 65us (1900us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786340.369007:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787786340.369010:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787786340.369090:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103b7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686761856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786340.369208:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103b7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686761856:12345-0@lo:400:kworker.0 Request processed in 120us (259us total) trans 0 rc 0/0 00000100:00080000:2.0:1787786340.369279:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787786340.369285:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787786340.370979:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1787786340.371117:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bc4f840 x1874629686761856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786340.371133:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc4f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686761856:0@lo:400:kworker.0 00010000:00080000:1.0:1787786340.371185:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bc4e940 x1874629686762112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786340.371195:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686762112:0@lo:400:kworker.0 00010000:00010000:1.0:1787786340.811090:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787786340.818487:0:9443:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.53 00000100:00100000:0.0:1787786340.883187:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787786340.883213:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686762240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787786340.883286:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786340.883383:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686762240 00000100:00100000:0.0:1787786340.883391:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686762240 00000100:00100000:0.0:1787786340.883442:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787786340.883452:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686762240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787786340.883492:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787786340.883538:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc4e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686762240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786340.883545:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1787786340.883586:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bc4d680 x1874629686762240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786340.883605:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686762240:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787786341.834620:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787786342.713213:0:9492:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Aug 26 19:19:01 EDT 2026 00010000:00010000:3.0:1787786342.858282:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786343.359955:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786343.360034:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786343.360189:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667856640 00000100:00100000:2.0:1787786343.360203:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667856640 00000100:00100000:2.0:1787786343.360312:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 46 00000100:00100000:2.0:1787786343.360330:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103b79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+6:2362:x1874629667856640:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786343.360433:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103b79680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+6:2362:x1874629667856640:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 110us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786343.360442:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 46 00000100:00080000:0.0:1787786343.361039:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787786343.363031:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667856512 00000100:00100000:3.0:1787786343.363053:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667856512 00000100:00100000:2.0:1787786343.363843:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 199 00000100:00100000:2.0:1787786343.363857:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:2362:x1874629667856512:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786343.365290:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:2362:x1874629667856512:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 1422us (5240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786343.365311:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 199 00010000:00010000:1.0:1787786343.885166:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786344.458269:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787786344.458303:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5206350f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686762368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787786344.458401:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786344.458550:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686762368 00000100:00100000:3.0:1787786344.458561:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686762368 00000100:00100000:3.0:1787786344.458775:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787786344.458785:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc99a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686762368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787786344.458879:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787786344.458948:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc99a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686762368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786344.458956:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1787786344.458984:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787786344.460039:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5206350f00 x1874629686762368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786344.460090:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5206350f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686762368:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787786344.906076:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786345.483894:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686762624:0@lo:400:kworker.0 00000100:00100000:1.0:1787786345.483998:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786345.484065:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686763136:0@lo:400:kworker.0 00000100:00100000:1.0:1787786345.484097:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786345.484253:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686762496:0@lo:400:kworker.0 00000100:00100000:0.0:1787786345.484294:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786345.484390:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874629686762752:0@lo:400:kworker.0 00000100:00100000:1.0:1787786345.484420:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786345.484443:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787786345.484450:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686762880:0@lo:400:kworker.0 00000100:00100000:2.0:1787786345.484468:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686763136 00000100:00100000:2.0:1787786345.484480:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686763136 00000100:00100000:1.0:1787786345.484518:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786345.484551:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686762624 00000100:00100000:2.0:1787786345.484560:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686762880 00000100:00100000:2.0:1787786345.484562:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686762880 00000100:00100000:1.0:1787786345.484563:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686762624 00000100:00100000:2.0:1787786345.484590:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787786345.484592:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686762752 00000100:00100000:1.0:1787786345.484594:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686762752 00000100:00100000:2.0:1787786345.484601:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103b7b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686763136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786345.484614:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787786345.484620:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103b7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686762624:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787786345.484761:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787786345.484767:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787786345.485188:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103b7b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686763136:12345-0@lo:400:kworker.0 Request processed in 587us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786345.485198:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787786345.485226:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787786345.485237:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206204b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686762880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786345.485276:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206204b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686762880:12345-0@lo:400:kworker.0 Request processed in 43us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786345.485282:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787786345.485742:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787786345.485758:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103b7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874629686762752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786345.485826:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103b7a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874629686762752:12345-0@lo:400:kworker.0 Request processed in 75us (1405us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786345.485834:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787786345.485867:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686762496 00000100:00100000:0.0:1787786345.485874:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686762496 00000100:00100000:0.0:1787786345.486383:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787786345.486396:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3313:x1874629686762496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786345.486461:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3313:x1874629686762496:12345-0@lo:400:kworker.0 Request processed in 69us (2166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786345.486484:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00010000:00080000:0.0:1787786345.489933:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5103b7bc00 x1874629686763136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786345.489957:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b7bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686763136:0@lo:400:kworker.0 00000100:00100000:1.0:1787786345.490404:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103b7a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686762624:12345-0@lo:400:kworker.0 Request processed in 5779us (6402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786345.490418:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787786345.490471:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686762624:0@lo:400:kworker.0 00010000:00080000:1.0:1787786345.490629:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5103b78780 x1874629686762880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786345.490656:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686762880:0@lo:400:kworker.0 00000100:00100000:1.0:1787786345.490672:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874629686762752:0@lo:400:kworker.0 00000100:00100000:3.0:1787786345.500084:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686762496:0@lo:400:kworker.0 00000100:00100000:3.0:1787786345.500105:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874629686763008:0@lo:400:kworker.0 00000100:00100000:3.0:1787786345.500326:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786345.501071:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686763008 00000100:00100000:3.0:1787786345.501083:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686763008 00000100:00100000:3.0:1787786345.501191:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787786345.501202:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874629686763008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786345.501817:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc9a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874629686763008:12345-0@lo:400:kworker.0 Request processed in 615us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786345.501826:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787786345.502096:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874629686763008:0@lo:400:kworker.0 00000100:00080000:2.0:1787786345.502484:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787786345.931154:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786345.994068:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787786345.994094:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686763264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787786345.994171:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786345.994283:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686763264 00000100:00100000:3.0:1787786345.994292:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686763264 00000100:00100000:3.0:1787786345.994347:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787786345.994356:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206352580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686763264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787786345.994391:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787786345.994460:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206352580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686763264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786345.994468:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1787786345.994674:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bc4f480 x1874629686763264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786345.994694:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686763264:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787786346.954474:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786347.979555:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786348.472057:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786348.472102:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786348.472470:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667856768 00000100:00100000:1.0:1787786348.472481:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667856768 00000100:00100000:1.0:1787786348.472544:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 201 00000100:00100000:1.0:1787786348.472558:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:2364:x1874629667856768:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1787786348.472662:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:2364:x1874629667856768:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 108us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786348.472673:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 201 00000100:00100000:0.0:1787786348.473162:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667856896 00000100:00100000:0.0:1787786348.473168:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667856896 00000100:00100000:0.0:1787786348.473266:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 50 00000100:00100000:0.0:1787786348.473275:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206350b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+6:2364:x1874629667856896:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1787786348.473319:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206350b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+6:2364:x1874629667856896:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 45us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786348.473325:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 50 00000100:00080000:3.0:1787786348.476381:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787786349.002027:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786349.578007:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787786349.578031:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5206350f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686763392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787786349.578100:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786349.578260:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686763392 00000100:00100000:2.0:1787786349.578268:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686763392 00000100:00100000:2.0:1787786349.578332:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787786349.578344:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52062061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686763392:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787786349.578460:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1787786349.578500:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787786349.578557:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52062061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686763392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 216us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786349.578564:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1787786349.578635:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5206350f00 x1874629686763392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786349.578653:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5206350f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686763392:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787786350.025999:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786350.603273:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686763648:0@lo:400:kworker.0 00000100:00100000:0.0:1787786350.603352:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786350.603407:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686764160:0@lo:400:kworker.0 00000100:00100000:0.0:1787786350.603437:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786350.603471:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787786350.603478:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc4d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3314:1874629686763520:0@lo:400:kworker.0 00000100:00100000:0.0:1787786350.603504:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786350.603524:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874629686764032:0@lo:400:kworker.0 00000100:00100000:0.0:1787786350.603548:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786350.603574:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874629686763776:0@lo:400:kworker.0 00000100:00100000:0.0:1787786350.603597:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786350.603615:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787786350.603621:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc4cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686763904:0@lo:400:kworker.0 00000100:00100000:0.0:1787786350.603653:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786350.603697:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686763648 00000100:00100000:0.0:1787786350.603706:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686763648 00000100:00100000:0.0:1787786350.603752:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686764032 00000100:00100000:0.0:1787786350.603756:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686764032 00000100:00100000:0.0:1787786350.603782:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686763776 00000100:00100000:0.0:1787786350.603785:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686763776 00000100:00100000:0.0:1787786350.603831:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787786350.603839:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686763648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786350.603896:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686763648:12345-0@lo:400:kworker.0 Request processed in 56us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786350.603915:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787786350.603936:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787786350.603943:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874629686764032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786350.603974:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874629686764032:12345-0@lo:400:kworker.0 Request processed in 33us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786350.603980:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787786350.603992:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787786350.603999:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874629686763776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786350.604032:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874629686763776:12345-0@lo:400:kworker.0 Request processed in 34us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786350.604037:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787786350.604056:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686764160 00000100:00100000:0.0:1787786350.604060:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686764160 00000100:00100000:0.0:1787786350.604089:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686763904 00000100:00100000:0.0:1787786350.604092:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686763904 00000100:00100000:0.0:1787786350.604108:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787786350.604113:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc4e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686764160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786350.604152:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc4e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686764160:12345-0@lo:400:kworker.0 Request processed in 39us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786350.604158:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787786350.604170:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787786350.604176:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc4ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686763904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786350.604199:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc4ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686763904:12345-0@lo:400:kworker.0 Request processed in 25us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786350.604205:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787786350.604223:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686763520 00000100:00100000:0.0:1787786350.604227:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686763520 00000100:00100000:0.0:1787786350.604254:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1787786350.604260:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3314:x1874629686763520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786350.604288:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3314:x1874629686763520:12345-0@lo:400:kworker.0 Request processed in 28us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786350.604295:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00080000:0.0:1787786350.604331:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787786350.604336:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787786350.604373:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bc4cf00 x1874629686763904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786350.604388:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc4cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686763904:0@lo:400:kworker.0 00000100:00100000:0.0:1787786350.604400:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874629686763776:0@lo:400:kworker.0 00000100:00100000:0.0:1787786350.604429:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc4d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3314:1874629686763520:0@lo:400:kworker.0 00000100:00100000:0.0:1787786350.604438:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874629686764032:0@lo:400:kworker.0 00000100:00100000:0.0:1787786350.604447:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc4c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686763648:0@lo:400:kworker.0 00010000:00080000:0.0:1787786350.604466:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bc4e940 x1874629686764160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786350.604474:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686764160:0@lo:400:kworker.0 00010000:00010000:2.0:1787786351.054270:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786351.114582:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686764288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787786351.114770:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786351.115118:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686764288 00000100:00100000:0.0:1787786351.115133:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686764288 00000100:00100000:1.0:1787786351.115404:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787786351.115421:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52063521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686764288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787786351.115468:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787786351.116478:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52063521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686764288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1062us (1704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786351.116489:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1787786351.120219:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bc4e940 x1874629686764288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786351.120248:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686764288:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787786352.074992:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786353.100590:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786353.587161:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786353.587209:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786353.587211:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667857152 00000100:00100000:0.0:1787786353.587221:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667857152 00000100:00100000:0.0:1787786353.587303:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 54 00000100:00100000:0.0:1787786353.587314:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206350f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+6:2362:x1874629667857152:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1787786353.587394:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206350f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+6:2362:x1874629667857152:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 82us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786353.587403:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 54 00000100:00100000:3.0:1787786353.587548:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667857024 00000100:00100000:3.0:1787786353.587553:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667857024 00000100:00100000:3.0:1787786353.587643:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 203 00000100:00100000:3.0:1787786353.587652:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:2363:x1874629667857024:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1787786353.587686:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:2363:x1874629667857024:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 36us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786353.587693:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 203 00000100:00080000:2.0:1787786353.588120:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787786354.122087:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786354.701237:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5206206940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686764416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787786354.701310:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786354.701433:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686764416 00000100:00100000:2.0:1787786354.701442:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686764416 00000100:00100000:2.0:1787786354.701513:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787786354.701523:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686764416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787786354.701558:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787786354.701618:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc4d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686764416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786354.701625:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1787786354.706201:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787786354.706269:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5206206940 x1874629686764416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786354.706298:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5206206940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686764416:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787786355.146021:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786355.722599:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc98f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686764672:0@lo:400:kworker.0 00000100:00100000:0.0:1787786355.722754:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786355.722781:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc98780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686764544:0@lo:400:kworker.0 00000100:00100000:2.0:1787786355.722853:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786355.722875:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686765184:0@lo:400:kworker.0 00000100:00100000:2.0:1787786355.722892:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874629686765056:0@lo:400:kworker.0 00000100:00100000:0.0:1787786355.722906:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786355.722913:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786355.722942:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686764928:0@lo:400:kworker.0 00000100:00100000:0.0:1787786355.722978:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786355.722997:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787786355.723003:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc9bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874629686764800:0@lo:400:kworker.0 00000100:00100000:0.0:1787786355.723032:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686764544 00000100:00100000:0.0:1787786355.723039:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686764544 00000100:00100000:0.0:1787786355.723081:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787786355.723090:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3313:x1874629686764544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786355.723135:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3313:x1874629686764544:12345-0@lo:400:kworker.0 Request processed in 46us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786355.723143:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1787786355.723173:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686765184 00000100:00100000:0.0:1787786355.723177:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686765184 00000100:00100000:0.0:1787786355.723205:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686764928 00000100:00100000:0.0:1787786355.723209:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686764928 00000100:00100000:1.0:1787786355.723210:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787786355.723217:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686765184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786355.723225:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787786355.723230:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686764928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786355.723257:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc4cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686765184:12345-0@lo:400:kworker.0 Request processed in 40us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786355.723257:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686764928:12345-0@lo:400:kworker.0 Request processed in 26us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786355.723263:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787786355.723271:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1787786355.723283:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787786355.723296:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5237c08b40 x1874629686765184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786355.723311:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c08b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686765184:0@lo:400:kworker.0 00000100:00100000:2.0:1787786355.734045:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc98780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686764544:0@lo:400:kworker.0 00000100:00100000:1.0:1787786355.734218:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786355.740501:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686764672 00000100:00100000:3.0:1787786355.740515:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686764672 00000100:00100000:3.0:1787786355.740870:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686765056 00000100:00100000:3.0:1787786355.740875:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686765056 00000100:00100000:0.0:1787786355.740885:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787786355.740898:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686764672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786355.741003:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686764672:12345-0@lo:400:kworker.0 Request processed in 109us (18250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786355.741025:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787786355.741042:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787786355.741048:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221a9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874629686765056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786355.741083:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221a9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874629686765056:12345-0@lo:400:kworker.0 Request processed in 37us (18170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786355.741089:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787786355.742045:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874629686765056:0@lo:400:kworker.0 00000100:00080000:2.0:1787786355.742099:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787786355.742135:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc98f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686764672:0@lo:400:kworker.0 00000100:00100000:2.0:1787786355.742190:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686764800 00000100:00100000:2.0:1787786355.742196:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686764800 00010000:00080000:1.0:1787786355.742207:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5237c09680 x1874629686764928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786355.742219:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686764928:0@lo:400:kworker.0 00000100:00100000:2.0:1787786355.742238:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787786355.742246:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206205a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874629686764800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786355.742310:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206205a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874629686764800:12345-0@lo:400:kworker.0 Request processed in 65us (8092us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786355.742317:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1787786355.742444:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787786355.743142:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc9bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874629686764800:0@lo:400:kworker.0 00010000:00010000:1.0:1787786356.170161:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786356.234853:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686765312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787786356.234931:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786356.235236:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686765312 00000100:00100000:0.0:1787786356.235245:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686765312 00000100:00100000:0.0:1787786356.235299:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787786356.235309:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221a9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686765312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787786356.235346:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787786356.235403:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221a9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686765312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786356.235410:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1787786356.236883:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bc4f0c0 x1874629686765312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786356.236907:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686765312:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1787786356.986434:0:10123:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 19:19:15 (1787786355) === 00010000:00010000:2.0:1787786357.194031:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786357.439133:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786357.439261:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667857280 00000100:00100000:0.0:1787786357.439273:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667857280 00000100:00100000:0.0:1787786357.439381:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 205 00000100:00100000:0.0:1787786357.439392:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:8151:x1874629667857280:12345-192.168.204.34@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787786357.439414:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786357.439439:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b520912c800/0x450132973bff2179 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752148 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786357.439470:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b520912c800/0x450132973bff2179 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752148 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786357.439481:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b520912c800/0x450132973bff2179 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752148 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786357.439509:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912c800, rc 0) 00000100:00100000:0.0:1787786357.439661:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+11:8151:x1874629667857280:12345-192.168.204.34@tcp:101:mount.lustre.0 Request processed in 270us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786357.439669:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 205 00000100:00100000:0.0:1787786357.445892:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786357.446057:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667857408 00000100:00100000:3.0:1787786357.446080:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667857408 00000100:00100000:3.0:1787786357.446140:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 206 00000100:00100000:3.0:1787786357.446150:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+11:8151:x1874629667857408:12345-192.168.204.34@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787786357.446503:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+11:8151:x1874629667857408:12345-192.168.204.34@tcp:501:mount.lustre.0 Request processed in 353us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786357.446512:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 206 00000100:00100000:1.0:1787786357.452445:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786357.452968:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667857536 00000100:00100000:0.0:1787786357.452979:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667857536 00000100:00100000:2.0:1787786357.453088:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 207 00000100:00100000:2.0:1787786357.453103:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+11:8151:x1874629667857536:12345-192.168.204.34@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787786357.453410:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+11:8151:x1874629667857536:12345-192.168.204.34@tcp:503:mount.lustre.0 Request processed in 311us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786357.453426:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 207 00000100:00100000:2.0:1787786357.459255:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786357.459835:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667857664 00000100:00100000:3.0:1787786357.459845:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667857664 00000100:00100000:3.0:1787786357.459946:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 208 00000100:00100000:3.0:1787786357.459969:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+11:8155:x1874629667857664:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787786357.460350:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+11:8155:x1874629667857664:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 384us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786357.460359:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 208 00000100:00100000:1.0:1787786357.476636:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786357.479455:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667857792 00000100:00100000:2.0:1787786357.479470:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667857792 00000100:00100000:2.0:1787786357.479569:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 209 00000100:00100000:2.0:1787786357.479585:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+11:8155:x1874629667857792:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787786357.480220:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+11:8155:x1874629667857792:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 638us (4067us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786357.480229:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 209 00000100:00100000:1.0:1787786357.484312:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786357.485016:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667857920 00000100:00100000:3.0:1787786357.485027:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667857920 00000100:00100000:3.0:1787786357.485121:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 210 00000100:00100000:3.0:1787786357.485133:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+11:8151:x1874629667857920:12345-192.168.204.34@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787786357.485160:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786357.485180:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b523bcb7400/0x450132973bff2180 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752172 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786357.485211:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b523bcb7400/0x450132973bff2180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752172 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786357.485224:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b523bcb7400/0x450132973bff2180 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752172 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786357.485253:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb7400, rc 0) 00000100:00100000:3.0:1787786357.485317:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+12:8151:x1874629667857920:12345-192.168.204.34@tcp:101:mount.lustre.0 Request processed in 186us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786357.485324:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 210 00000100:00100000:3.0:1787786357.489114:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786357.489775:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667858048 00000100:00100000:2.0:1787786357.489786:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667858048 00000100:00100000:2.0:1787786357.489954:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 211 00000100:00100000:2.0:1787786357.489965:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+12:8151:x1874629667858048:12345-192.168.204.34@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787786357.489996:0:5840:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787786357.490024:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787786357.490029:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787786357.490033:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787786357.490035:0:5840:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787786357.491895:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+12:8151:x1874629667858048:12345-192.168.204.34@tcp:256:mount.lustre.0 Request processed in 1921us (2781us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786357.491910:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 211 00000100:00100000:1.0:1787786357.494865:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786357.494946:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667858176 00000100:00100000:3.0:1787786357.494972:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667858176 00000100:00100000:3.0:1787786357.495028:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 212 00000100:00100000:3.0:1787786357.495038:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+12:8151:x1874629667858176:12345-192.168.204.34@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787786357.495055:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786357.495071:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b523bcb7c00/0x450132973bff2187 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752179 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786357.495097:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b523bcb7c00/0x450132973bff2187 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752179 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786357.495108:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b523bcb7c00/0x450132973bff2187 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752179 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786357.495116:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb7c00, rc 0) 00000100:00100000:3.0:1787786357.495171:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:8151:x1874629667858176:12345-192.168.204.34@tcp:101:mount.lustre.0 Request processed in 134us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786357.495178:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 212 00000100:00100000:3.0:1787786357.497011:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786357.499362:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667858304 00000100:00100000:2.0:1787786357.499376:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667858304 00000100:00100000:2.0:1787786357.499452:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 213 00000100:00100000:2.0:1787786357.499462:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:8151:x1874629667858304:12345-192.168.204.34@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787786357.500341:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:8151:x1874629667858304:12345-192.168.204.34@tcp:501:mount.lustre.0 Request processed in 872us (3329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786357.500352:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 213 00000100:00100000:1.0:1787786357.502770:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786357.502883:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667858432 00000100:00100000:0.0:1787786357.502893:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667858432 00000100:00100000:0.0:1787786357.502949:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 214 00000100:00100000:0.0:1787786357.502959:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:8151:x1874629667858432:12345-192.168.204.34@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787786357.503198:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:8151:x1874629667858432:12345-192.168.204.34@tcp:503:mount.lustre.0 Request processed in 239us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786357.503206:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 214 00000100:00100000:1.0:1787786357.506495:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786357.506782:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667858560 00000100:00100000:2.0:1787786357.506833:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667858560 00000100:00100000:2.0:1787786357.506929:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 215 00000100:00100000:2.0:1787786357.506939:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:8158:x1874629667858560:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787786357.507216:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:8158:x1874629667858560:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 277us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786357.507224:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 215 00000100:00100000:0.0:1787786357.509646:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786357.509766:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667858688 00000100:00100000:2.0:1787786357.509775:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667858688 00000100:00100000:2.0:1787786357.509839:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 216 00000100:00100000:2.0:1787786357.509850:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:8158:x1874629667858688:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787786357.510362:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:8158:x1874629667858688:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 512us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786357.510371:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 216 00000100:00100000:1.0:1787786357.514511:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786357.514565:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786357.514652:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667858816 00000100:00100000:2.0:1787786357.514662:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667858816 00000100:00100000:2.0:1787786357.514703:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667859200 00000100:00100000:2.0:1787786357.514705:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667859200 00000100:00100000:2.0:1787786357.514752:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 58 00000100:00100000:2.0:1787786357.514761:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206207480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+6:2364:x1874629667859200:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786357.514860:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206207480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+6:2364:x1874629667859200:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 100us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786357.514947:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00100000:3.0:1787786357.514953:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206204000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2361:x1874629667858816:12345-192.168.204.34@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787786357.514992:0:7644:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6e407027-7940-45d9-87d7-56031cd08b7a@192.168.204.34@tcp t0 exp 0000000000000000 cur 283 last 0 00000020:00000080:3.0:1787786357.515042:0:7644:0:(genops.c:1385:class_connect()) connect: client 6e407027-7940-45d9-87d7-56031cd08b7a, cookie 0x450132973bff218e 00000004:00100000:3.0:1787786357.515073:0:7644:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787786357.515342:0:7644:0:(import.c:65:import_set_state_nolock()) ffff8b5237c45000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787786357.515371:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206204000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e407027-7940-45d9-87d7-56031cd08b7a+6:2361:x1874629667858816:12345-192.168.204.34@tcp:38:mount.lustre.0 Request processed in 417us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786357.515379:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00080000:1.0:1787786357.515562:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787786357.515605:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 58 00000100:00100000:1.0:1787786357.522859:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786357.523313:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667858944 00000100:00100000:0.0:1787786357.523324:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667858944 00000100:00100000:0.0:1787786357.523393:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 11 00000100:00100000:0.0:1787786357.523402:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52062043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e407027-7940-45d9-87d7-56031cd08b7a+6:0:x1874629667858944:12345-192.168.204.34@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787786357.523443:0:5847:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787786357.523526:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52062043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e407027-7940-45d9-87d7-56031cd08b7a+6:0:x1874629667858944:12345-192.168.204.34@tcp:41:mount.lustre.0 Request processed in 125us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786357.523534:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 11 00000100:00100000:1.0:1787786357.523786:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786357.523833:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667859072 00000100:00100000:1.0:1787786357.523837:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667859072 00000100:00100000:1.0:1787786357.523862:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00100000:1.0:1787786357.523870:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206205e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e407027-7940-45d9-87d7-56031cd08b7a+6:8151:x1874629667859072:12345-192.168.204.34@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787786357.523882:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787786357.523910:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206205e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e407027-7940-45d9-87d7-56031cd08b7a+6:8151:x1874629667859072:12345-192.168.204.34@tcp:41:mount.lustre.0 Request processed in 41us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786357.523916:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00080000:2.0:1787786357.524056:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787786357.535445:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786357.535638:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667859328 00000100:00100000:1.0:1787786357.535649:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667859328 00000100:00100000:1.0:1787786357.535714:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 13 00000100:00100000:1.0:1787786357.535723:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e407027-7940-45d9-87d7-56031cd08b7a+6:8151:x1874629667859328:12345-192.168.204.34@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787786357.535846:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e407027-7940-45d9-87d7-56031cd08b7a+6:8151:x1874629667859328:12345-192.168.204.34@tcp:40:mount.lustre.0 Request processed in 124us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786357.535871:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 13 00000100:00100000:0.0:1787786357.540896:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786357.540952:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786357.540987:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786357.541141:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667859456 00000100:00100000:2.0:1787786357.541152:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667859456 00000100:00100000:2.0:1787786357.541193:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667859584 00000100:00100000:2.0:1787786357.541196:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667859584 00000100:00100000:2.0:1787786357.541214:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00100000:2.0:1787786357.541222:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc4d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2361:x1874629667859456:12345-192.168.204.34@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787786357.541258:0:6698:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6e407027-7940-45d9-87d7-56031cd08b7a@192.168.204.34@tcp t0 exp 0000000000000000 cur 283 last 0 00000020:00000080:2.0:1787786357.541293:0:6698:0:(genops.c:1385:class_connect()) connect: client 6e407027-7940-45d9-87d7-56031cd08b7a, cookie 0x450132973bff2195 00002000:00100000:2.0:1787786357.541305:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6e407027-7940-45d9-87d7-56031cd08b7a/ffff8b5235530000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113935 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787786357.541328:0:6698:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787786357.541586:0:6698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787786357.541617:0:6698:0:(import.c:65:import_set_state_nolock()) ffff8b5235536800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787786357.541687:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc4d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e407027-7940-45d9-87d7-56031cd08b7a+6:2361:x1874629667859456:12345-192.168.204.34@tcp:8:mount.lustre.0 Request processed in 464us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786357.541695:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00100000:2.0:1787786357.541715:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 13 00000100:00100000:2.0:1787786357.541720:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2361:x1874629667859584:12345-192.168.204.34@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787786357.541735:0:6698:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6e407027-7940-45d9-87d7-56031cd08b7a@192.168.204.34@tcp t0 exp 0000000000000000 cur 283 last 0 00000020:00000080:2.0:1787786357.541750:0:6698:0:(genops.c:1385:class_connect()) connect: client 6e407027-7940-45d9-87d7-56031cd08b7a, cookie 0x450132973bff219c 00002000:00100000:2.0:1787786357.541756:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6e407027-7940-45d9-87d7-56031cd08b7a/ffff8b5235536000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113935 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787786357.541763:0:6698:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787786357.541935:0:6698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787786357.541961:0:6698:0:(import.c:65:import_set_state_nolock()) ffff8b5235531000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787786357.541988:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e407027-7940-45d9-87d7-56031cd08b7a+6:2361:x1874629667859584:12345-192.168.204.34@tcp:8:mount.lustre.0 Request processed in 266us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786357.542009:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 13 00000100:00100000:3.0:1787786357.542273:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667859712 00000100:00100000:3.0:1787786357.542279:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667859712 00000100:00100000:3.0:1787786357.542318:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 1 00000100:00100000:3.0:1787786357.542326:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e407027-7940-45d9-87d7-56031cd08b7a+6:8151:x1874629667859712:12345-192.168.204.34@tcp:33:mount.lustre.0 00000004:00200000:3.0:1787786357.542496:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787786357.542622:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6e407027-7940-45d9-87d7-56031cd08b7a+6:8151:x1874629667859712:12345-192.168.204.34@tcp:33:mount.lustre.0 Request processed in 296us (1669us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786357.542629:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 1 00000001:00100000:3.0:1787786357.818269:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6e407027-7940-45d9-87d7-56031cd08b7a 00000001:00100000:0.0:1787786357.825717:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e407027-7940-45d9-87d7-56031cd08b7a 00010000:00010000:2.0:1787786358.218111:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786359.242101:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786359.820722:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787786359.826289:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686765440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787786359.826399:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786359.826616:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686765440 00000100:00100000:0.0:1787786359.826628:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686765440 00000100:00100000:0.0:1787786359.827438:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787786359.827453:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc9bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686765440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787786359.827517:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787786359.827594:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc9bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686765440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786359.827601:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1787786359.827764:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bc4de00 x1874629686765440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786359.827814:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686765440:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787786359.828025:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787786360.267201:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786360.842346:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874629686765824:0@lo:400:kworker.0 00000100:00100000:3.0:1787786360.842447:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686765696:0@lo:400:kworker.0 00000100:00100000:1.0:1787786360.843162:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686765568:0@lo:400:kworker.0 00000100:00100000:3.0:1787786360.844257:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786360.844344:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686766208:0@lo:400:kworker.0 00000100:00100000:3.0:1787786360.844376:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786360.844503:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686765696 00000100:00100000:2.0:1787786360.844511:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686765696 00000100:00100000:2.0:1787786360.844568:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787786360.844579:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686765696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786360.844642:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686765696:12345-0@lo:400:kworker.0 Request processed in 65us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786360.844651:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787786360.844694:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686766208 00000100:00100000:2.0:1787786360.844698:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686766208 00000100:00100000:2.0:1787786360.844738:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787786360.844747:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686766208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786360.844781:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686766208:12345-0@lo:400:kworker.0 Request processed in 36us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786360.844811:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1787786360.844830:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787786360.844882:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686765952:0@lo:400:kworker.0 00000100:00100000:2.0:1787786360.844913:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786360.845571:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686765952 00000100:00100000:2.0:1787786360.845579:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686765952 00000100:00100000:2.0:1787786360.845615:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787786360.845622:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc98780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686765952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786360.845671:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc98780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686765952:12345-0@lo:400:kworker.0 Request processed in 49us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786360.845677:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1787786360.845714:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5103b7b0c0 x1874629686765952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786360.845729:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686765952:0@lo:400:kworker.0 00010000:00080000:3.0:1787786360.845833:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5103b7ad00 x1874629686766208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786360.845844:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686766208:0@lo:400:kworker.0 00000100:00100000:3.0:1787786360.845866:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686765696:0@lo:400:kworker.0 00000100:00100000:0.0:1787786360.847593:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786360.850557:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786360.850671:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874629686766080:0@lo:400:kworker.0 00000100:00100000:3.0:1787786360.850695:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686765824 00000100:00100000:3.0:1787786360.850705:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686765824 00000100:00100000:1.0:1787786360.850712:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786360.850754:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686766080 00000100:00100000:1.0:1787786360.850758:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686766080 00000100:00100000:3.0:1787786360.850774:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787786360.850786:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103b7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874629686765824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786360.850861:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686765568 00000100:00100000:2.0:1787786360.850866:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686765568 00000100:00100000:3.0:1787786360.850871:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103b7bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874629686765824:12345-0@lo:400:kworker.0 Request processed in 86us (3284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786360.850904:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1787786360.850912:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3313:x1874629686765568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786360.850967:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3313:x1874629686765568:12345-0@lo:400:kworker.0 Request processed in 56us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786360.850974:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00080000:2.0:1787786360.851023:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787786360.851059:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874629686765824:0@lo:400:kworker.0 00000100:00100000:1.0:1787786360.851823:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787786360.851836:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206206d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874629686766080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786360.851886:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206206d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874629686766080:12345-0@lo:400:kworker.0 Request processed in 54us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786360.851893:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787786360.852155:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787786360.852235:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686765568:0@lo:400:kworker.0 00000100:00100000:1.0:1787786360.852260:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874629686766080:0@lo:400:kworker.0 00000001:00100000:1.0:1787786360.928112:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e407027-7940-45d9-87d7-56031cd08b7a 00010000:00010000:2.0:1787786361.293063:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786361.354018:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc98f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686766336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787786361.354148:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786361.354211:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686766336 00000100:00100000:0.0:1787786361.354220:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686766336 00000100:00100000:0.0:1787786361.354282:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787786361.354292:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5233338000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686766336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787786361.354329:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787786361.354385:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5233338000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686766336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786361.354392:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1787786361.354553:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bc98f00 x1874629686766336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786361.354574:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc98f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686766336:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787786362.314179:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787786362.786450:0:10319:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg434-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1787786362.808952:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786362.809122:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667859968 00000100:00100000:3.0:1787786362.809133:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667859968 00000100:00100000:3.0:1787786362.809205:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 62 00000100:00100000:3.0:1787786362.809216:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52333383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+6:2364:x1874629667859968:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1787786362.809289:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52333383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+6:2364:x1874629667859968:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 75us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786362.809297:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 62 00000100:00080000:0.0:1787786362.809482:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787786362.809701:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786362.809747:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786362.809767:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667860224 00000100:00100000:3.0:1787786362.809772:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667860224 00000100:00100000:2.0:1787786362.809779:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786362.809832:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 35 00000100:00100000:3.0:1787786362.809840:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5233339e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e407027-7940-45d9-87d7-56031cd08b7a+5:2364:x1874629667860224:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1787786362.809875:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5233339e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e407027-7940-45d9-87d7-56031cd08b7a+5:2364:x1874629667860224:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 36us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786362.809882:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 35 00000100:00100000:2.0:1787786362.809888:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786362.810101:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667860096 00000100:00100000:2.0:1787786362.810105:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667860096 00000100:00100000:2.0:1787786362.810139:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 63 00000100:00100000:2.0:1787786362.810147:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52333392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e407027-7940-45d9-87d7-56031cd08b7a+5:2364:x1874629667860096:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786362.810179:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52333392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e407027-7940-45d9-87d7-56031cd08b7a+5:2364:x1874629667860096:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 33us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786362.810185:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 63 00000100:00100000:0.0:1787786362.810276:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667859840 00000100:00100000:0.0:1787786362.810281:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667859840 00000100:00100000:0.0:1787786362.810312:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 218 00000100:00100000:0.0:1787786362.810319:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2364:x1874629667859840:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1787786362.810368:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2364:x1874629667859840:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 49us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786362.810375:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 218 00000100:00080000:0.0:1787786362.810475:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787786362.810480:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787786362.811215:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667860352 00000100:00100000:3.0:1787786362.811223:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667860352 00000100:00100000:3.0:1787786362.811312:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 36 00000100:00100000:3.0:1787786362.811321:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523333ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e407027-7940-45d9-87d7-56031cd08b7a+5:2364:x1874629667860352:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1787786362.811378:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523333ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e407027-7940-45d9-87d7-56031cd08b7a+5:2364:x1874629667860352:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 57us (1488us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786362.811393:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 36 00000100:00080000:0.0:1787786362.812174:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787786363.338818:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786364.362061:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786364.938191:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686766464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787786364.938269:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786364.939170:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686766464 00000100:00100000:0.0:1787786364.939179:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686766464 00000100:00100000:0.0:1787786364.939264:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787786364.939279:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523333b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686766464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787786364.939318:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787786364.939383:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523333b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686766464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786364.939390:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1787786364.939482:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5103b792c0 x1874629686766464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786364.939505:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686766464:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787786364.940113:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787786365.388341:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786365.962078:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686766720:0@lo:400:kworker.0 00000100:00100000:3.0:1787786365.962206:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786365.962311:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b435a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686767232:0@lo:400:kworker.0 00000100:00100000:0.0:1787786365.962320:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686766720 00000100:00100000:0.0:1787786365.962331:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686766720 00000100:00100000:3.0:1787786365.962348:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786365.962402:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787786365.962412:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3314:1874629686766592:0@lo:400:kworker.0 00000100:00100000:0.0:1787786365.962422:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787786365.962437:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686766720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786365.962458:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786365.962493:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874629686767104:0@lo:400:kworker.0 00000100:00100000:0.0:1787786365.962532:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686766720:12345-0@lo:400:kworker.0 Request processed in 98us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786365.962537:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786365.962551:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787786365.962588:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686767104 00000100:00100000:0.0:1787786365.962592:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686767104 00000100:00100000:3.0:1787786365.962598:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b7b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686766720:0@lo:400:kworker.0 00000100:00100000:0.0:1787786365.962644:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787786365.962652:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5205314780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874629686767104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786365.962655:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686767232 00000100:00100000:3.0:1787786365.962663:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686767232 00000100:00100000:0.0:1787786365.962719:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5205314780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874629686767104:12345-0@lo:400:kworker.0 Request processed in 67us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786365.962730:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787786365.962743:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5205316d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686767232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786365.962749:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1787786365.962784:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787786365.962836:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787786365.962857:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5205316d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686767232:12345-0@lo:400:kworker.0 Request processed in 115us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786365.962867:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787786365.962885:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686766592 00000100:00100000:0.0:1787786365.962892:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686766592 00000100:00100000:3.0:1787786365.962919:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b78780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874629686767104:0@lo:400:kworker.0 00000100:00100000:0.0:1787786365.962942:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1787786365.962953:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3314:x1874629686766592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786365.962992:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3314:x1874629686766592:12345-0@lo:400:kworker.0 Request processed in 42us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786365.962998:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1787786365.963119:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686766976:0@lo:400:kworker.0 00000100:00100000:1.0:1787786365.963163:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787786365.963180:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523b435a40 x1874629686767232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786365.963199:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b435a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686767232:0@lo:400:kworker.0 00000100:00100000:1.0:1787786365.963204:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787786365.963218:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874629686766848:0@lo:400:kworker.0 00000100:00100000:3.0:1787786365.963248:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3314:1874629686766592:0@lo:400:kworker.0 00000100:00100000:1.0:1787786365.963256:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786365.963406:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686766848 00000100:00100000:1.0:1787786365.963412:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686766848 00000100:00100000:1.0:1787786365.963452:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787786365.963459:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52062052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874629686766848:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787786365.963496:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787786365.963505:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52062052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874629686766848:12345-0@lo:400:kworker.0 Request processed in 44us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786365.963515:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787786365.963577:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874629686766848:0@lo:400:kworker.0 00000100:00100000:0.0:1787786365.964163:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686766976 00000100:00100000:0.0:1787786365.964169:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686766976 00000100:00100000:0.0:1787786365.964244:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787786365.964253:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52062070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686766976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786365.964303:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52062070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686766976:12345-0@lo:400:kworker.0 Request processed in 52us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786365.964309:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1787786365.966889:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5103b792c0 x1874629686766976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786365.966910:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b792c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686766976:0@lo:400:kworker.0 00010000:00010000:2.0:1787786366.411958:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786366.479407:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787786366.479432:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686767360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787786366.479504:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786366.479669:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686767360 00000100:00100000:0.0:1787786366.479678:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686767360 00000100:00100000:0.0:1787786366.479766:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787786366.479777:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206207c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686767360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787786366.479837:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787786366.479886:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206207c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686767360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786366.479894:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1787786366.479985:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523b437480 x1874629686767360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786366.480006:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686767360:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787786367.436205:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786367.925753:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786367.926008:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786367.926051:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786367.926072:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786367.926094:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786367.926120:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667860608 00000100:00100000:0.0:1787786367.926130:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667860608 00000100:00100000:0.0:1787786367.926186:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667860736 00000100:00100000:0.0:1787786367.926190:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667860736 00000100:00100000:0.0:1787786367.926214:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 67 00000100:00100000:0.0:1787786367.926225:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+6:2363:x1874629667860608:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1787786367.926304:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+6:2363:x1874629667860608:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 80us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786367.926313:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 67 00000100:00100000:0.0:1787786367.926330:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 68 00000100:00100000:0.0:1787786367.927072:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b435e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e407027-7940-45d9-87d7-56031cd08b7a+5:2362:x1874629667860736:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1787786367.927167:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b435e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e407027-7940-45d9-87d7-56031cd08b7a+5:2362:x1874629667860736:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 830us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786367.927175:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 68 00000100:00080000:0.0:1787786367.927215:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787786367.927447:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667860864 00000100:00100000:3.0:1787786367.927454:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667860864 00000100:00100000:3.0:1787786367.927564:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667860992 00000100:00100000:3.0:1787786367.927568:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667860992 00000100:00100000:3.0:1787786367.927590:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 39 00000100:00100000:3.0:1787786367.927599:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e407027-7940-45d9-87d7-56031cd08b7a+5:2363:x1874629667860864:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1787786367.927637:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e407027-7940-45d9-87d7-56031cd08b7a+5:2363:x1874629667860864:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 39us (1563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786367.927643:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 39 00000100:00100000:3.0:1787786367.927657:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 40 00000100:00100000:3.0:1787786367.927664:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b436d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e407027-7940-45d9-87d7-56031cd08b7a+5:2362:x1874629667860992:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1787786367.927689:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b436d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e407027-7940-45d9-87d7-56031cd08b7a+5:2362:x1874629667860992:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 26us (1594us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786367.927695:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 40 00000100:00080000:0.0:1787786367.927991:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787786367.927996:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787786367.928397:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667860480 00000100:00100000:1.0:1787786367.928414:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667860480 00000100:00100000:1.0:1787786367.929414:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 220 00000100:00100000:1.0:1787786367.929490:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2362:x1874629667860480:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1787786367.929566:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2362:x1874629667860480:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 142us (3823us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786367.929724:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 220 00010000:00010000:2.0:1787786368.458969:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786369.482954:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786370.058134:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686767488:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787786370.058208:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786370.058324:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686767488 00000100:00100000:2.0:1787786370.058333:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686767488 00000100:00100000:0.0:1787786370.058475:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787786370.058488:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206204f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686767488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787786370.058533:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787786370.058702:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206204f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686767488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 208us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786370.058710:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1787786370.059154:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523b4370c0 x1874629686767488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786370.059172:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686767488:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787786370.060310:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787786370.505973:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786371.083639:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5206206580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686767616:0@lo:400:kworker.0 00000100:00100000:1.0:1787786371.083677:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5206207840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874629686767872:0@lo:400:kworker.0 00000100:00100000:0.0:1787786371.083723:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786371.083783:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5206205680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874629686768128:0@lo:400:kworker.0 00000100:00100000:3.0:1787786371.084006:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5206206940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686767744:0@lo:400:kworker.0 00000100:00100000:3.0:1787786371.084050:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786371.084076:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc98f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686768256:0@lo:400:kworker.0 00000100:00100000:3.0:1787786371.084101:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786371.084123:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686767744 00000100:00100000:2.0:1787786371.084132:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686767744 00000100:00100000:3.0:1787786371.084151:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686768256 00000100:00100000:3.0:1787786371.084157:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686768256 00000100:00100000:3.0:1787786371.084204:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787786371.084215:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103b78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686768256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786371.084391:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787786371.084401:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103b792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686767744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786371.084486:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786371.084517:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786371.084533:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103b78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686768256:12345-0@lo:400:kworker.0 Request processed in 319us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786371.084556:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787786371.084558:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686767616 00000100:00100000:0.0:1787786371.084563:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686767616 00000100:00080000:3.0:1787786371.084582:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787786371.084598:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787786371.084600:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686767872 00000100:00100000:3.0:1787786371.084606:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686767872 00000100:00100000:0.0:1787786371.084608:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3313:x1874629686767616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786371.084640:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686768128 00000100:00100000:3.0:1787786371.084644:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686768128 00000100:00100000:0.0:1787786371.084657:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3313:x1874629686767616:12345-0@lo:400:kworker.0 Request processed in 50us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786371.084666:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1787786371.084667:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1787786371.084679:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874629686767872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786371.084720:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5206206580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686767616:0@lo:400:kworker.0 00000100:00100000:3.0:1787786371.084723:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc4de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874629686767872:12345-0@lo:400:kworker.0 Request processed in 46us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786371.084732:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787786371.084748:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787786371.084754:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b434b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874629686768128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786371.084807:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b434b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874629686768128:12345-0@lo:400:kworker.0 Request processed in 36us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786371.084813:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1787786371.084825:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787786371.084916:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bc98f00 x1874629686768256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786371.084928:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc98f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686768256:0@lo:400:kworker.0 00000100:00100000:0.0:1787786371.084948:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5206205680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874629686768128:0@lo:400:kworker.0 00000100:00100000:2.0:1787786371.085085:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103b792c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686767744:12345-0@lo:400:kworker.0 Request processed in 685us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786371.085102:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787786371.085107:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5206206940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686767744:0@lo:400:kworker.0 00000100:00100000:1.0:1787786371.085487:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5206207840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874629686767872:0@lo:400:kworker.0 00000100:00100000:1.0:1787786371.085503:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787786371.085513:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5206204780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686768000:0@lo:400:kworker.0 00000100:00100000:1.0:1787786371.085553:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786371.085579:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686768000 00000100:00100000:0.0:1787786371.085585:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686768000 00000100:00100000:0.0:1787786371.085622:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787786371.085630:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5207200c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686768000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786371.085672:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5207200c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686768000:12345-0@lo:400:kworker.0 Request processed in 43us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786371.085678:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1787786371.086321:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5206204780 x1874629686768000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786371.086333:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5206204780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686768000:0@lo:400:kworker.0 00010000:00010000:2.0:1787786371.534233:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786371.594774:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787786371.594840:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b436d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686768384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787786371.594945:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786371.595145:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686768384 00000100:00100000:0.0:1787786371.595157:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686768384 00000100:00100000:0.0:1787786371.595325:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787786371.595338:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5233338f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686768384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787786371.595395:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787786371.595538:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5233338f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686768384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 203us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786371.595546:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1787786371.597592:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523b436d00 x1874629686768384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786387 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786371.597629:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b436d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686768384:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787786372.554085:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786373.044282:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786373.044321:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786373.044346:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786373.044365:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786373.044389:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786373.044416:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667861248 00000100:00100000:0.0:1787786373.044426:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667861248 00000100:00100000:0.0:1787786373.044483:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667861376 00000100:00100000:0.0:1787786373.044486:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667861376 00000100:00100000:0.0:1787786373.044518:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 72 00000100:00100000:0.0:1787786373.044529:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b436580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+6:2365:x1874629667861248:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1787786373.044613:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b436580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+6:2365:x1874629667861248:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 87us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786373.044622:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 72 00000100:00100000:0.0:1787786373.044645:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 73 00000100:00100000:0.0:1787786373.044652:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e407027-7940-45d9-87d7-56031cd08b7a+5:2365:x1874629667861376:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1787786373.044678:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e407027-7940-45d9-87d7-56031cd08b7a+5:2365:x1874629667861376:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 27us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786373.044683:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 73 00000100:00100000:1.0:1787786373.045746:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667861120 00000100:00100000:1.0:1787786373.046100:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667861120 00000100:00100000:1.0:1787786373.046150:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 222 00000100:00100000:1.0:1787786373.046158:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2365:x1874629667861120:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1787786373.046205:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2365:x1874629667861120:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 48us (1858us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786373.046211:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 222 00000100:00080000:1.0:1787786373.046372:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787786373.046388:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667861504 00000100:00100000:1.0:1787786373.046394:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667861504 00000100:00100000:1.0:1787786373.046438:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667861632 00000100:00100000:1.0:1787786373.046442:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667861632 00000100:00100000:1.0:1787786373.046464:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 43 00000100:00100000:1.0:1787786373.046471:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b435680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e407027-7940-45d9-87d7-56031cd08b7a+5:2365:x1874629667861504:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1787786373.046501:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b435680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e407027-7940-45d9-87d7-56031cd08b7a+5:2365:x1874629667861504:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 31us (2180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786373.046508:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 43 00000100:00100000:1.0:1787786373.046519:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 44 00000100:00100000:1.0:1787786373.046525:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b437840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e407027-7940-45d9-87d7-56031cd08b7a+5:2365:x1874629667861632:12345-192.168.204.34@tcp:400:kworker.0 00000100:00080000:0.0:1787786373.046543:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787786373.046548:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787786373.046550:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b437840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e407027-7940-45d9-87d7-56031cd08b7a+5:2365:x1874629667861632:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 23us (2159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786373.046557:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 44 00010000:00010000:1.0:1787786373.578920:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786374.602276:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786375.182016:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787786375.182040:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc4ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686768512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787786375.182109:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786375.182301:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686768512 00000100:00100000:0.0:1787786375.182310:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686768512 00000100:00100000:0.0:1787786375.182395:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787786375.182405:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103b7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686768512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787786375.182442:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787786375.182498:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103b7b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686768512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786375.182505:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1787786375.182619:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bc4ed00 x1874629686768512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786375.182642:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc4ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686768512:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787786375.182736:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787786375.629436:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787786375.682579:0:11020:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1787786376.205120:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686768640:0@lo:400:kworker.0 00000100:00100000:3.0:1787786376.205152:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874629686768896:0@lo:400:kworker.0 00000100:00100000:2.0:1787786376.205259:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b7a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686769024:0@lo:400:kworker.0 00000100:00100000:1.0:1787786376.205343:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686768768:0@lo:400:kworker.0 00000100:00100000:2.0:1787786376.211907:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786376.212034:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686769024 00000100:00100000:2.0:1787786376.212043:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686769024 00000100:00100000:2.0:1787786376.212085:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787786376.212094:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5233339680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686769024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786376.212151:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5233339680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686769024:12345-0@lo:400:kworker.0 Request processed in 58us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786376.212158:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1787786376.212548:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5103b7a580 x1874629686769024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786376.212570:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b7a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686769024:0@lo:400:kworker.0 00000100:00100000:1.0:1787786376.214100:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786376.214145:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686769280:0@lo:400:kworker.0 00000100:00100000:1.0:1787786376.214173:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786376.214209:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787786376.214216:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874629686769152:0@lo:400:kworker.0 00000100:00100000:1.0:1787786376.214235:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786376.214275:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686769280 00000100:00100000:1.0:1787786376.214282:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686769280 00000100:00100000:1.0:1787786376.214329:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787786376.214338:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686769280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786376.214386:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686769280:12345-0@lo:400:kworker.0 Request processed in 48us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786376.214393:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787786376.214419:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686768768 00000100:00100000:1.0:1787786376.214424:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686768768 00000100:00100000:0.0:1787786376.214430:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786376.214455:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686769152 00000100:00100000:1.0:1787786376.214460:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686769152 00000100:00100000:1.0:1787786376.214487:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787786376.214494:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686768768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786376.214525:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686768768:12345-0@lo:400:kworker.0 Request processed in 32us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786376.214531:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787786376.214542:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787786376.214547:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874629686769152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786376.214569:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874629686769152:12345-0@lo:400:kworker.0 Request processed in 23us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786376.214574:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1787786376.214602:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787786376.214606:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787786376.214636:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b7b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874629686769152:0@lo:400:kworker.0 00000100:00100000:1.0:1787786376.214646:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686768768:0@lo:400:kworker.0 00010000:00080000:1.0:1787786376.214657:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5103b78b40 x1874629686769280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786376.214667:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686769280:0@lo:400:kworker.0 00000100:00100000:0.0:1787786376.214717:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686768640 00000100:00100000:0.0:1787786376.214723:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686768640 00000100:00100000:0.0:1787786376.214847:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787786376.214857:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3313:x1874629686768640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786376.214908:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3313:x1874629686768640:12345-0@lo:400:kworker.0 Request processed in 53us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786376.214915:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787786376.214981:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b7ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686768640:0@lo:400:kworker.0 00000100:00100000:3.0:1787786376.215424:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786376.215524:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686768896 00000100:00100000:0.0:1787786376.215529:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686768896 00000100:00080000:1.0:1787786376.215637:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787786376.215674:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787786376.215684:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103b7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874629686768896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786376.215749:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103b7ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874629686768896:12345-0@lo:400:kworker.0 Request processed in 67us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786376.215756:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1787786376.215829:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874629686768896:0@lo:400:kworker.0 00010000:00010000:1.0:1787786376.650093:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786376.714067:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787786376.714092:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523333a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686769408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787786376.714180:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786376.714257:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686769408 00000100:00100000:1.0:1787786376.714265:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686769408 00000100:00100000:1.0:1787786376.714320:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787786376.714332:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523333b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686769408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787786376.714371:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787786376.714417:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523333b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686769408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786376.714424:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1787786376.719541:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523333a1c0 x1874629686769408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786376.719577:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523333a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686769408:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787786377.673966:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786378.165929:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786378.165975:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786378.166001:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786378.166034:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786378.166059:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786378.166088:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667861760 00000100:00100000:1.0:1787786378.166098:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667861760 00000100:00100000:3.0:1787786378.166239:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667861888 00000100:00100000:3.0:1787786378.166243:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667861888 00000100:00100000:3.0:1787786378.166294:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667862016 00000100:00100000:3.0:1787786378.166297:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667862016 00000100:00100000:3.0:1787786378.166318:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 77 00000100:00100000:3.0:1787786378.166326:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+6:2364:x1874629667861888:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1787786378.166402:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+6:2364:x1874629667861888:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 77us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786378.166409:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 77 00000100:00100000:3.0:1787786378.166425:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 78 00000100:00100000:3.0:1787786378.166431:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e407027-7940-45d9-87d7-56031cd08b7a+5:2364:x1874629667862016:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1787786378.166453:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e407027-7940-45d9-87d7-56031cd08b7a+5:2364:x1874629667862016:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 22us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786378.166458:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 78 00000100:00080000:3.0:1787786378.166474:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787786378.166920:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667862144 00000100:00100000:3.0:1787786378.166925:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667862144 00000100:00100000:3.0:1787786378.166965:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667862272 00000100:00100000:3.0:1787786378.166970:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667862272 00000100:00100000:3.0:1787786378.166991:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 14 00000100:00100000:3.0:1787786378.166998:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc4e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e407027-7940-45d9-87d7-56031cd08b7a+5:2361:x1874629667862144:12345-192.168.204.34@tcp:9:kworker.0 00000020:00000080:3.0:1787786378.167031:0:8126:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff2195 00000100:00080000:3.0:1787786378.167040:0:8126:0:(import.c:65:import_set_state_nolock()) ffff8b5235536800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787786378.167076:0:8126:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787786378.167557:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc4e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e407027-7940-45d9-87d7-56031cd08b7a+2:2361:x1874629667862144:12345-192.168.204.34@tcp:9:kworker.0 Request processed in 557us (1519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786378.167566:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 14 00000100:00100000:3.0:1787786378.167582:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 15 00000100:00100000:3.0:1787786378.167592:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e407027-7940-45d9-87d7-56031cd08b7a+5:2361:x1874629667862272:12345-192.168.204.34@tcp:9:kworker.0 00000020:00000080:3.0:1787786378.167605:0:8126:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff219c 00000100:00080000:3.0:1787786378.167611:0:8126:0:(import.c:65:import_set_state_nolock()) ffff8b5235531000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787786378.167820:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 224 00000100:00100000:1.0:1787786378.167831:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2364:x1874629667861760:12345-192.168.204.34@tcp:400:kworker.0 00010000:00010000:0.0:1787786378.168114:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1787786378.168331:0:8126:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787786378.168571:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6e407027-7940-45d9-87d7-56031cd08b7a+2:2361:x1874629667862272:12345-192.168.204.34@tcp:9:kworker.0 Request processed in 980us (2509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786378.168580:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 15 00000100:00100000:1.0:1787786378.168723:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2364:x1874629667861760:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 894us (2747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786378.168730:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 224 00010000:00010000:1.0:1787786378.168763:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787786378.168922:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787786378.168926:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1787786378.281531:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e407027-7940-45d9-87d7-56031cd08b7a 00000020:00000080:2.0:1787786378.281542:0:7647:0:(genops.c:885:class_export_put()) final put ffff8b5235536000/6e407027-7940-45d9-87d7-56031cd08b7a 00000020:00000080:3.0:1787786378.281577:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5235536000/6e407027-7940-45d9-87d7-56031cd08b7a for lustre-OST0001 00000020:00000080:3.0:1787786378.281629:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5235531000 for lustre-OST0001 00010000:00010000:0.0:1787786378.700603:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787786379.144598:0:11168:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef4648f90 20000000:00000080:3.0:1787786379.144618:0:11168:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8b5237abd400 uarg=0000000000000000 20000000:01000000:3.0:1787786379.144654:0:11168:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787786379.144660:0:11168:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1787786379.144665:0:11168:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787786379.150655:0:11169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1787786379.150877:0:11168:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1787786379.165185:0:11168:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787786379.165312:0:11168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b5201676600/0x450132973bff21a3 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786379.165342:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b5237aaca00/0x450132973bff2148 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752141 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786379.165354:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b520912d200/0x450132973bff2156 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff214f expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786379.165361:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b523bcb7800/0x450132973bff2164 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff215d expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786379.165369:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b5237aada00/0x450132973bff2172 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff216b expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786379.165376:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b523bcb7c00/0x450132973bff2187 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752179 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786379.165384:0:11168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b5201676600/0x450132973bff21a3 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786379.165453:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b523bcb7c00/0x450132973bff2187 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752179 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786379.165471:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b523bcb7c00/0x450132973bff2187 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752179 expref: 12 pid: 5839 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786379.165521:0:11168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523298b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1874629686769536:192.168.204.34@tcp:104: 00010000:00010000:1.0:1787786379.165658:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b5237aada00/0x450132973bff2172 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff216b expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786379.165667:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b5237aada00/0x450132973bff2172 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff216b expref: 18 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786379.165675:0:11168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5232988780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1874629686769664:0@lo:104: 00000100:00100000:1.0:1787786379.165716:0:11168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787786379.165753:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b523bcb7800/0x450132973bff2164 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff215d expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786379.165761:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b523bcb7800/0x450132973bff2164 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff215d expref: 18 pid: 5839 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786379.165769:0:11168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5232988f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1874629686769792:0@lo:104: 00000100:00100000:2.0:1787786379.165989:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686769664 00000100:00100000:2.0:1787786379.165998:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686769664 00000100:00100000:2.0:1787786379.166067:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787786379.166078:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5232988b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+3:11168:x1874629686769664:12345-0@lo:104: 00010000:00010000:2.0:1787786379.166092:0:7632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7a00/0x450132973bff216b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff2172 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786379.166162:0:7632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787786379.166169:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5232988b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+3:11168:x1874629686769664:12345-0@lo:104: Request processed in 94us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786379.166178:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1787786379.166182:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787786379.166192:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7a00/0x450132973bff216b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff2172 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786379.166202:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7a00 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:0.0:1787786379.166208:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7a00/0x450132973bff216b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff2172 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786379.166218:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7a00/0x450132973bff216b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff2172 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787786379.166226:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7a00/0x450132973bff216b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff2172 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787786379.166232:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1787786379.166260:0:11168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787786379.166277:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7a00/0x450132973bff216b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff2172 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786379.166284:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787786379.166299:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b520912d200/0x450132973bff2156 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff214f expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786379.166304:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686769792 00010000:00010000:0.0:1787786379.166308:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7a00/0x450132973bff216b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff2172 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786379.166310:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686769792 00010000:00010000:1.0:1787786379.166315:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b520912d200/0x450132973bff2156 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff214f expref: 18 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786379.166322:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7a00/0x450132973bff216b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff2172 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786379.166331:0:11168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5232989680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1874629686770048:0@lo:104: 00010000:00010000:0.0:1787786379.166340:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786379.166343:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786379.166345:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1787786379.166346:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786379.166356:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787786379.166362:0:11168:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786379.166367:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523298a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+3:11168:x1874629686769792:12345-0@lo:104: 00000100:00100000:0.0:1787786379.166372:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b437c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686769920:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787786379.166378:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6600/0x450132973bff215d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff2164 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786379.166387:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b5237aaca00/0x450132973bff2148 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752141 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786379.166415:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b5237aaca00/0x450132973bff2148 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752141 expref: 12 pid: 5839 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786379.166427:0:11168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523298b840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1874629686770176:192.168.204.34@tcp:104: 00000100:00100000:0.0:1787786379.166433:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787786379.166464:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787786379.166464:0:8508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686769920 00000100:00100000:1.0:1787786379.166470:0:8508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686769920 00000100:00100000:3.0:1787786379.166472:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523298a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+3:11168:x1874629686769792:12345-0@lo:104: Request processed in 110us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786379.166480:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787786379.166495:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686770048 00000100:00100000:3.0:1787786379.166498:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686770048 00010000:00010000:1.0:1787786379.166501:0:8508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b5237aada00/0x450132973bff2172 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff216b expref: 19 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786379.166517:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787786379.166525:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523298a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+3:11168:x1874629686770048:12345-0@lo:104: 00010000:00010000:3.0:1787786379.166532:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff8b5237aad800/0x450132973bff214f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff2156 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786379.166534:0:8508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787786379.166546:0:8508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5207bdd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3311:x1874629686769920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787786379.166559:0:8508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786379.166565:0:8508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b5237aada00/0x450132973bff2172 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff216b expref: 19 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786379.166576:0:8508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b5237aada00/0x450132973bff2172 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff216b expref: 19 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786379.166580:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787786379.166589:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523298a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+3:11168:x1874629686770048:12345-0@lo:104: Request processed in 65us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786379.166596:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1787786379.166596:0:8508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787786379.166624:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1787786379.166630:0:8508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5207bdd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3311:x1874629686769920:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (196us total) trans 0 rc 0/0 00010000:00010000:3.0:1787786379.166631:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6600/0x450132973bff215d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff2164 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786379.166645:0:8508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1787786379.166646:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb6600 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:3.0:1787786379.166651:0:7633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6600/0x450132973bff215d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff2164 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786379.166658:0:7633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6600/0x450132973bff215d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff2164 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787786379.166675:0:7633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6600/0x450132973bff215d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff2164 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786379.166681:0:7633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787786379.166699:0:7633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6600/0x450132973bff215d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff2164 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786379.166705:0:7633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1787786379.166709:0:11168:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5206d47480 going to sleep for 11 seconds 00010000:00010000:3.0:1787786379.166726:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6600/0x450132973bff215d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff2164 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786379.166734:0:11168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5237aada00/0x450132973bff2172 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff216b expref: 18 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786379.166736:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6600/0x450132973bff215d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff2164 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786379.166755:0:11168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5232988780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1874629686769664:0@lo:104: 00010000:00010000:3.0:1787786379.166757:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787786379.166762:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b5237aad800/0x450132973bff214f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff2156 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786379.166768:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786379.166769:0:11168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5232988f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1874629686769792:0@lo:104: 00010000:00010000:3.0:1787786379.166770:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aad800 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:3.0:1787786379.166774:0:7633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b5237aad800/0x450132973bff214f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff2156 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786379.166786:0:7633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b5237aad800/0x450132973bff214f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff2156 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786379.166817:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b437c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686769920:0@lo:103:ldlm_bl.0 10000000:00010000:3.0:1787786379.166861:0:7633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b5237aad800/0x450132973bff214f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff2156 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786379.166867:0:7633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1787786379.166926:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686770304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787786379.167029:0:11168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5232989680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1874629686770048:0@lo:104: 00010000:00010000:3.0:1787786379.167295:0:7633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b5237aad800/0x450132973bff214f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff2156 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786379.167302:0:7633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787786379.167310:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b5237aad800/0x450132973bff214f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff2156 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786379.167316:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b5237aad800/0x450132973bff214f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff2156 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786379.167329:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786379.167330:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786379.167332:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786379.167343:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3314:1874629686770432:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787786379.175449:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786379.175629:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686770304 00000100:00100000:1.0:1787786379.175640:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686770304 00010000:00010000:1.0:1787786379.175954:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b523bcb7800/0x450132973bff2164 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff215d expref: 18 pid: 5839 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786379.176370:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787786379.176382:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523333a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:3313:x1874629686770304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787786379.176401:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786379.176407:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b523bcb7800/0x450132973bff2164 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff215d expref: 18 pid: 5839 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786379.176420:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b523bcb7800/0x450132973bff2164 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff215d expref: 18 pid: 5839 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786379.176438:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b523bcb7800/0x450132973bff2164 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff215d expref: 18 pid: 5839 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786379.176457:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786379.176592:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523333a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:3313:x1874629686770304:12345-0@lo:103:ldlm_bl.0 Request processed in 212us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786379.176601:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787786379.176688:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686770304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787786379.176848:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786379.176870:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667862400 00000100:00100000:2.0:1787786379.176875:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667862400 00010000:00010000:2.0:1787786379.176894:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b523bcb7c00/0x450132973bff2187 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752179 expref: 13 pid: 5839 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786379.176916:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 27 00000100:00100000:2.0:1787786379.176923:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523333bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2365:x1874629667862400:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787786379.176932:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787786379.176937:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b523bcb7c00/0x450132973bff2187 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752179 expref: 13 pid: 5839 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786379.176992:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b523bcb7c00/0x450132973bff2187 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752179 expref: 13 pid: 5839 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786379.177004:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787786379.177046:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523333bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2365:x1874629667862400:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 124us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786379.177054:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 27 00010000:00010000:1.0:1787786379.177667:0:11168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b523bcb7c00/0x450132973bff2187 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752179 expref: 12 pid: 5839 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786379.177683:0:11168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523298b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1874629686769536:192.168.204.34@tcp:104: 00000100:00100000:2.0:1787786379.182429:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786379.182565:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686770432 00000100:00100000:0.0:1787786379.182575:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686770432 00010000:00010000:0.0:1787786379.182619:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b520912d200/0x450132973bff2156 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff214f expref: 17 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786379.182656:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787786379.182665:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523333a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:3314:x1874629686770432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787786379.182680:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787786379.182686:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b520912d200/0x450132973bff2156 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff214f expref: 17 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786379.182696:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00010000:00010000:0.0:1787786379.182701:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b520912d200/0x450132973bff2156 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff214f expref: 17 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786379.182722:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b520912d200/0x450132973bff2156 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff214f expref: 17 pid: 5841 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786379.182737:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787786379.182771:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667862528 00000100:00100000:2.0:1787786379.182776:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667862528 00000100:00100000:0.0:1787786379.182808:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523333a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:3314:x1874629686770432:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786379.182817:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1787786379.182823:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b5237aaca00/0x450132973bff2148 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752141 expref: 12 pid: 5839 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786379.182851:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 29 00000100:00100000:0.0:1787786379.182860:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523298bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+12:2364:x1874629667862528:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787786379.182881:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787786379.182887:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b5237aaca00/0x450132973bff2148 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752141 expref: 12 pid: 5839 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786379.182897:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b5237aaca00/0x450132973bff2148 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752141 expref: 12 pid: 5839 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786379.182908:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3314:1874629686770432:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787786379.182911:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b5201676600/0x450132973bff21a3 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786379.182922:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5201676600/0x450132973bff21a3 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786379.182941:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b5201676600/0x450132973bff21a3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786379.182949:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b5201676600/0x450132973bff21a3 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786379.183743:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b5201676600/0x450132973bff21a3 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786379.183757:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b5201676600/0x450132973bff21a3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786379.183764:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5201676600 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:0.0:1787786379.183769:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b5201676600/0x450132973bff21a3 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786379.183777:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b5201676600/0x450132973bff21a3 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786379.183827:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b5201676600/0x450132973bff21a3 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786379.183840:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787786379.183900:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523298bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+12:2364:x1874629667862528:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 1040us (1207us total) trans 0 rc 0/0 00010000:00010000:3.0:1787786379.186283:0:11168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5237aaca00/0x450132973bff2148 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752141 expref: 12 pid: 5839 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786379.186305:0:11168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523298b840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1874629686770176:192.168.204.34@tcp:104: 00010000:00010000:3.0:1787786379.186340:0:11168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b5201676600/0x450132973bff21a3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786379.186350:0:11168:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b5201676600/0x450132973bff21a3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786379.186357:0:11168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b5201676600/0x450132973bff21a3 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786379.186364:0:11168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5201676600/0x450132973bff21a3 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786379.187978:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 29 00010000:00010000:0.0:1787786379.722080:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786380.300309:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787786380.300335:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523298ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686770560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787786380.300406:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786380.300532:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686770560 00000100:00100000:1.0:1787786380.300541:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686770560 00000100:00100000:1.0:1787786380.300604:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787786380.300613:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5233339a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686770560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787786380.300646:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787786380.300702:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5233339a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686770560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786380.300710:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1787786380.300827:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523298ad00 x1874629686770560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786380.300849:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523298ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686770560:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787786380.301076:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:0.0:1787786380.553928:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787786380.553936:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b5213768000 from 7 10000000:01000000:0.0:1787786380.553941:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787786380.553999:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520912c400/0x450132973bff21aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786380.554011:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b520912c400/0x450132973bff21aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786380.554023:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b520912c400/0x450132973bff21aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786380.554052:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b437c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686770688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787786380.554132:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786380.554180:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5237b013c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787786380.554836:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686770688 00000100:00100000:2.0:1787786380.554843:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686770688 00000100:00100000:2.0:1787786380.554896:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787786380.554905:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:5843:x1874629686770688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787786380.554923:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786380.554940:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5237aacc00/0x450132973bff21b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff21aa expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786380.554990:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5237aacc00/0x450132973bff21b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff21aa expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786380.555000:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5237aacc00/0x450132973bff21b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff21aa expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786380.555009:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aacc00, rc 0) 00000100:00100000:2.0:1787786380.555062:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:5843:x1874629686770688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786380.555069:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787786380.555273:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b437c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686770688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787786380.555290:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b520912c400/0x450132973bff21aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff21b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786380.555300:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b520912c400/0x450132973bff21aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff21b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786380.555366:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b437c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686770816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787786380.555396:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786380.555433:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5237b013c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787786380.556707:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686770816 00000100:00100000:2.0:1787786380.556718:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686770816 00000100:00100000:2.0:1787786380.556766:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1787786380.556774:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:5843:x1874629686770816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787786380.558325:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:5843:x1874629686770816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1544us (2921us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786380.558338:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1787786380.562115:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b437c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686770816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787786380.562375:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b7a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686770944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787786380.562926:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786380.563016:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5206304840 going to sleep for 11 seconds 00000100:00100000:2.0:1787786380.565754:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686770944 00000100:00100000:2.0:1787786380.565768:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686770944 00000100:00100000:2.0:1787786380.565854:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787786380.565864:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:5843:x1874629686770944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787786380.566380:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:5843:x1874629686770944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 516us (3453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786380.566389:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787786380.566670:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b7a580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686770944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787786380.577945:0:11202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787786380.578010:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787786380.578033:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787786380.578046:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520912c400/0x450132973bff21aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff21b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786380.578058:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b520912c400/0x450132973bff21aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff21b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787786380.578069:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787786380.578072:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b5206233000 from 7 10000000:01000000:1.0:1787786380.578075:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787786380.578124:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b5201677c00/0x450132973bff21b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786380.578133:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b5201677c00/0x450132973bff21b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786380.578145:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b5201677c00/0x450132973bff21b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786380.578173:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523298a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686771072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787786380.578266:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786380.578311:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5208839180 going to sleep for 11 seconds 00000100:00100000:2.0:1787786380.578966:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686771072 00000100:00100000:2.0:1787786380.578975:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686771072 00000100:00100000:2.0:1787786380.579033:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1787786380.579041:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:5843:x1874629686771072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787786380.579056:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786380.579068:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5237aac400/0x450132973bff21bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff21b8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786380.579101:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5237aac400/0x450132973bff21bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff21b8 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786380.579114:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5237aac400/0x450132973bff21bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff21b8 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786380.579123:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aac400, rc 0) 00000100:00100000:2.0:1787786380.579170:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:5843:x1874629686771072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786380.579177:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1787786380.579323:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523298a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686771072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787786380.579338:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b5201677c00/0x450132973bff21b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff21bf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786380.579347:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b5201677c00/0x450132973bff21b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff21bf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786380.579404:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523298a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686771200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787786380.579436:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786380.579537:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686771200 00000100:00100000:3.0:1787786380.579541:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686771200 00000100:00100000:3.0:1787786380.579569:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1787786380.579577:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:5843:x1874629686771200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787786380.581937:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5208839180 going to sleep for 11 seconds 00000100:00100000:3.0:1787786380.586055:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:5843:x1874629686771200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 6468us (6607us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786380.586069:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1787786380.586253:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523298a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686771200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787786380.586309:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523298a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686771328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787786380.586362:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786380.586405:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5208839180 going to sleep for 11 seconds 00000100:00100000:3.0:1787786380.586567:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686771328 00000100:00100000:3.0:1787786380.586574:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686771328 00000100:00100000:3.0:1787786380.586630:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1787786380.586640:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:5843:x1874629686771328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787786380.586785:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:5843:x1874629686771328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786380.586817:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1787786380.587056:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523298a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686771328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787786380.590738:0:11205:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787786380.591070:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787786380.591103:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787786380.591115:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b5201677c00/0x450132973bff21b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff21bf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786380.591127:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b5201677c00/0x450132973bff21b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff21bf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786380.591138:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787786380.591154:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b5207b73000 from 7 10000000:01000000:3.0:1787786380.591158:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787786380.591194:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6a00/0x450132973bff21c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786380.591203:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6a00/0x450132973bff21c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786380.591214:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6a00/0x450132973bff21c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786380.591242:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b78780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686771456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787786380.591312:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786380.591363:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b521145f240 going to sleep for 11 seconds 00000100:00100000:1.0:1787786380.592478:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686771456 00000100:00100000:1.0:1787786380.592489:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686771456 00000100:00100000:1.0:1787786380.592540:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1787786380.592549:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:5843:x1874629686771456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787786380.592566:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786380.592809:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5201677a00/0x450132973bff21cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff21c6 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786380.592850:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5201677a00/0x450132973bff21cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff21c6 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786380.592862:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5201677a00/0x450132973bff21cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff21c6 expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786380.592871:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5201677a00, rc 0) 00000100:00100000:1.0:1787786380.592942:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:5843:x1874629686771456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 394us (1630us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786380.592949:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1787786380.593055:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b78780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686771456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787786380.593073:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6a00/0x450132973bff21c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff21cd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786380.593083:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6a00/0x450132973bff21c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff21cd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786380.593163:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b78780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686771584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787786380.593195:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786380.593236:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b521145f240 going to sleep for 11 seconds 00000100:00100000:1.0:1787786380.593867:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686771584 00000100:00100000:1.0:1787786380.593874:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686771584 00000100:00100000:1.0:1787786380.593915:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787786380.593923:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:5843:x1874629686771584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787786380.594184:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:5843:x1874629686771584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786380.594192:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787786380.594235:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b78780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686771584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787786380.594274:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523298a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686771712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787786380.594316:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786380.594333:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b446540 going to sleep for 11 seconds 00000100:00100000:1.0:1787786380.594345:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686771712 00000100:00100000:1.0:1787786380.594349:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686771712 00000100:00100000:1.0:1787786380.594371:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787786380.594377:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:5843:x1874629686771712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787786380.599320:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:5843:x1874629686771712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 4933us (4994us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786380.599333:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787786380.599479:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523298a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686771712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1787786380.608445:0:11206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787786380.610961:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787786380.610992:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787786380.611005:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6a00/0x450132973bff21c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff21cd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786380.611026:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6a00/0x450132973bff21c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff21cd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786380.747779:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786381.046650:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786381.046780:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667862656 00000100:00100000:3.0:1787786381.046804:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667862656 00000100:00100000:3.0:1787786381.046863:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 234 00000100:00100000:3.0:1787786381.046874:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+11:5620:x1874629667862656:12345-192.168.204.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787786381.046893:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786381.046912:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b523bcb6600/0x450132973bff21d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7521a3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786381.046943:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b523bcb6600/0x450132973bff21d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521a3 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786381.046956:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b523bcb6600/0x450132973bff21d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521a3 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786381.046965:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb6600, rc 0) 00000100:00100000:3.0:1787786381.047030:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+12:5620:x1874629667862656:12345-192.168.204.34@tcp:101:ll_cfg_requeue.0 Request processed in 157us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786381.047037:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 234 00000100:00100000:1.0:1787786381.050947:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786381.051105:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667862784 00000100:00100000:2.0:1787786381.051114:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667862784 00000100:00100000:2.0:1787786381.051177:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 235 00000100:00100000:2.0:1787786381.051187:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+12:5620:x1874629667862784:12345-192.168.204.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787786381.052532:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+12:5620:x1874629667862784:12345-192.168.204.34@tcp:501:ll_cfg_requeue.0 Request processed in 1340us (1587us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786381.052544:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 235 00000100:00100000:0.0:1787786381.060890:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786381.060968:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667862912 00000100:00100000:2.0:1787786381.060979:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667862912 00000100:00100000:2.0:1787786381.061028:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 236 00000100:00100000:2.0:1787786381.061046:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+12:5620:x1874629667862912:12345-192.168.204.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787786381.061292:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+12:5620:x1874629667862912:12345-192.168.204.34@tcp:503:ll_cfg_requeue.0 Request processed in 247us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786381.061300:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 236 00000100:00100000:0.0:1787786381.075771:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786381.075871:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667863040 00000100:00100000:1.0:1787786381.075885:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667863040 00000100:00100000:1.0:1787786381.076196:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 237 00000100:00100000:1.0:1787786381.076206:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+12:5620:x1874629667863040:12345-192.168.204.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787786381.076224:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786381.076240:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5201676600/0x450132973bff21db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7521aa expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786381.076266:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5201676600/0x450132973bff21db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521aa expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786381.076277:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5201676600/0x450132973bff21db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521aa expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786381.076285:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5201676600, rc 0) 00000100:00100000:1.0:1787786381.077119:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:5620:x1874629667863040:12345-192.168.204.34@tcp:101:ll_cfg_requeue.0 Request processed in 908us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786381.077128:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 237 00000100:00100000:0.0:1787786381.078923:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786381.078991:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667863168 00000100:00100000:3.0:1787786381.079000:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667863168 00000100:00100000:3.0:1787786381.079049:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 238 00000100:00100000:3.0:1787786381.079060:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:5620:x1874629667863168:12345-192.168.204.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787786381.079347:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:5620:x1874629667863168:12345-192.168.204.34@tcp:501:ll_cfg_requeue.0 Request processed in 288us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786381.079363:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 238 00000100:00100000:1.0:1787786381.083291:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786381.083359:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667863296 00000100:00100000:3.0:1787786381.083368:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667863296 00000100:00100000:3.0:1787786381.083420:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 239 00000100:00100000:3.0:1787786381.083431:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:5620:x1874629667863296:12345-192.168.204.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787786381.083665:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:5620:x1874629667863296:12345-192.168.204.34@tcp:503:ll_cfg_requeue.0 Request processed in 235us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786381.083674:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 239 00000100:00100000:1.0:1787786381.323015:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52329883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686772224:0@lo:400:kworker.0 00000100:00100000:1.0:1787786381.323263:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786381.323392:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5232989a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686771840:0@lo:400:kworker.0 00000100:00100000:2.0:1787786381.323427:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786381.323454:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5232989e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874629686772352:0@lo:400:kworker.0 00000100:00100000:2.0:1787786381.323479:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786381.323490:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5232988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686771968:0@lo:400:kworker.0 00000100:00100000:2.0:1787786381.323509:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686771840 00000100:00100000:2.0:1787786381.323516:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686771840 00000100:00100000:2.0:1787786381.323558:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1787786381.323578:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3312:x1874629686771840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786381.323622:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786381.323628:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f88850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3312:x1874629686771840:12345-0@lo:400:kworker.0 Request processed in 63us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786381.323636:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787786381.323636:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52329892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686772480:0@lo:400:kworker.0 00000100:00100000:1.0:1787786381.323655:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786381.323666:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686772352 00000100:00100000:2.0:1787786381.323670:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686772352 00000100:00100000:1.0:1787786381.323672:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787786381.323676:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523298b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686772096:0@lo:400:kworker.0 00000100:00100000:2.0:1787786381.323700:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686771968 00000100:00100000:2.0:1787786381.323702:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686771968 00000100:00100000:1.0:1787786381.323703:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786381.323718:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686772096 00000100:00100000:2.0:1787786381.323720:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686772096 00000100:00100000:2.0:1787786381.323737:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787786381.323743:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5233339e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874629686772352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786381.323775:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5233339e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874629686772352:12345-0@lo:400:kworker.0 Request processed in 32us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786381.323781:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787786381.323826:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787786381.323832:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523298ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686771968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786381.323867:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523298ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686771968:12345-0@lo:400:kworker.0 Request processed in 35us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786381.323873:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787786381.323884:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787786381.323890:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523298b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686772096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786381.323914:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5232988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686771968:0@lo:400:kworker.0 00000100:00100000:2.0:1787786381.323915:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523298b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686772096:12345-0@lo:400:kworker.0 Request processed in 26us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786381.323921:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787786381.323934:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523298b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686772096:0@lo:400:kworker.0 00000100:00100000:3.0:1787786381.325186:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686772224 00000100:00100000:3.0:1787786381.325197:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686772224 00000100:00100000:3.0:1787786381.325235:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686772480 00000100:00100000:3.0:1787786381.325238:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686772480 00000100:00100000:3.0:1787786381.325265:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787786381.325275:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523298a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686772224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786381.325344:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523298a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686772224:12345-0@lo:400:kworker.0 Request processed in 70us (2081us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786381.325350:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787786381.325365:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787786381.325372:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523298b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686772480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786381.325407:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523298b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686772480:12345-0@lo:400:kworker.0 Request processed in 36us (1750us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786381.325413:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1787786381.325437:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787786381.325442:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787786381.325518:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b52329892c0 x1874629686772480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786381.325544:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52329892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686772480:0@lo:400:kworker.0 00010000:00080000:3.0:1787786381.325578:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b52329883c0 x1874629686772224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786381.325589:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52329883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686772224:0@lo:400:kworker.0 00000100:00100000:3.0:1787786381.325943:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5232989a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686771840:0@lo:400:kworker.0 00000100:00100000:3.0:1787786381.325958:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5232989e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874629686772352:0@lo:400:kworker.0 00000001:00100000:1.0:1787786381.417491:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e407027-7940-45d9-87d7-56031cd08b7a 00000020:00000080:1.0:1787786381.417500:0:6723:0:(genops.c:885:class_export_put()) final put ffff8b5235530000/6e407027-7940-45d9-87d7-56031cd08b7a 00000020:00000080:3.0:1787786381.417638:0:481:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5235530000/6e407027-7940-45d9-87d7-56031cd08b7a for lustre-OST0000 00000020:00000080:3.0:1787786381.417762:0:481:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5235536800 for lustre-OST0000 00010000:00010000:1.0:1787786381.770719:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786381.838214:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787786381.838240:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b436940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686772608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787786381.838313:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786381.838380:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686772608 00000100:00100000:0.0:1787786381.838387:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686772608 00000100:00100000:0.0:1787786381.838433:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787786381.838442:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b437c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686772608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787786381.838476:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787786381.838517:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b437c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686772608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786381.838524:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1787786381.838563:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523b436940 x1874629686772608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786381.838581:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b436940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686772608:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787786382.794922:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787786383.003550:0:11369:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg434-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1787786383.291071:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786383.291135:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786383.291177:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786383.291386:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667863424 00000100:00100000:3.0:1787786383.291478:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667863424 00000100:00100000:3.0:1787786383.291614:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 241 00000100:00100000:3.0:1787786383.291628:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2364:x1874629667863424:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786383.291845:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667863680 00000100:00100000:2.0:1787786383.291859:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667863680 00000100:00100000:3.0:1787786383.291878:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2364:x1874629667863424:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 251us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786383.291888:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 241 00000100:00080000:3.0:1787786383.291954:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787786383.292017:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667863552 00000100:00100000:2.0:1787786383.292023:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667863552 00000100:00100000:2.0:1787786383.292083:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 82 00000100:00100000:2.0:1787786383.292093:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b436940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e407027-7940-45d9-87d7-56031cd08b7a+5:2364:x1874629667863680:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786383.292173:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b436940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e407027-7940-45d9-87d7-56031cd08b7a+5:2364:x1874629667863680:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 82us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786383.292570:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 82 00000100:00080000:3.0:1787786383.293022:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787786383.293645:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 83 00000100:00100000:1.0:1787786383.293668:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b434f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+6:2364:x1874629667863552:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1787786383.293830:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b434f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+6:2364:x1874629667863552:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 173us (2651us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786383.293838:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 83 00010000:00010000:2.0:1787786383.818195:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786384.846272:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786385.419170:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523333ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686772736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787786385.419242:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786385.420992:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686772736 00000100:00100000:1.0:1787786385.421017:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686772736 00000100:00100000:1.0:1787786385.421101:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787786385.421112:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103b7b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686772736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787786385.421156:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787786385.421252:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103b7b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686772736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (2008us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786385.421260:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1787786385.421323:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523333ad00 x1874629686772736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786385.421347:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523333ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686772736:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787786385.423509:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787786385.866152:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786386.442002:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5232989680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686772992:0@lo:400:kworker.0 00000100:00100000:1.0:1787786386.442099:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786386.442155:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5232989e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686773504:0@lo:400:kworker.0 00000100:00100000:1.0:1787786386.442180:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786386.442210:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787786386.442215:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5232988f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686773120:0@lo:400:kworker.0 00000100:00100000:1.0:1787786386.442237:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786386.442273:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686772992 00000100:00100000:1.0:1787786386.442281:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686772992 00000100:00100000:1.0:1787786386.442330:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686773120 00000100:00100000:1.0:1787786386.442333:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686773120 00000100:00100000:1.0:1787786386.442366:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787786386.442376:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5232989a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686772992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786386.442447:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5232989a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686772992:12345-0@lo:400:kworker.0 Request processed in 71us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786386.442455:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787786386.442486:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787786386.442493:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52329892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686773120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786386.442520:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52329892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686773120:12345-0@lo:400:kworker.0 Request processed in 29us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786386.442527:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1787786386.442547:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787786386.442580:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5232988f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686773120:0@lo:400:kworker.0 00000100:00100000:1.0:1787786386.442606:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5232989680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686772992:0@lo:400:kworker.0 00000100:00100000:3.0:1787786386.444606:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5232988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686772864:0@lo:400:kworker.0 00000100:00100000:3.0:1787786386.444707:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786386.444777:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523298b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874629686773376:0@lo:400:kworker.0 00000100:00100000:3.0:1787786386.444834:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786386.444862:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787786386.444868:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5232988780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686773248:0@lo:400:kworker.0 00000100:00100000:3.0:1787786386.444890:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786386.444924:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686773376 00000100:00100000:3.0:1787786386.444932:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686773376 00000100:00100000:3.0:1787786386.445008:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787786386.445018:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103b78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874629686773376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786386.445072:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103b78780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874629686773376:12345-0@lo:400:kworker.0 Request processed in 56us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786386.445090:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787786386.445112:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686773504 00000100:00100000:3.0:1787786386.445115:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686773504 00000100:00100000:3.0:1787786386.445138:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686773248 00000100:00100000:3.0:1787786386.445140:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686773248 00000100:00100000:3.0:1787786386.445156:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787786386.445161:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52329883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686773504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786386.445198:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52329883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686773504:12345-0@lo:400:kworker.0 Request processed in 36us (3017us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786386.445204:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787786386.445214:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787786386.445219:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103b7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686773248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786386.445245:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103b7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686773248:12345-0@lo:400:kworker.0 Request processed in 26us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786386.445251:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787786386.445266:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686772864 00000100:00100000:3.0:1787786386.445276:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686772864 00000100:00100000:3.0:1787786386.445302:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787786386.445308:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3312:x1874629686772864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786386.445339:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066ccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3312:x1874629686772864:12345-0@lo:400:kworker.0 Request processed in 33us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786386.445345:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00010000:00080000:3.0:1787786386.445393:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5232988780 x1874629686773248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786386.445419:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5232988780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686773248:0@lo:400:kworker.0 00000100:00100000:3.0:1787786386.445430:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5232988000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686772864:0@lo:400:kworker.0 00000100:00100000:3.0:1787786386.445438:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523298b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874629686773376:0@lo:400:kworker.0 00000100:00080000:3.0:1787786386.445466:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787786386.445470:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787786386.445488:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5232989e00 x1874629686773504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786386.445497:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5232989e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686773504:0@lo:400:kworker.0 00010000:00010000:2.0:1787786386.890271:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786386.954032:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b436d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686773632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787786386.954105:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786386.954203:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686773632 00000100:00100000:2.0:1787786386.954213:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686773632 00000100:00100000:2.0:1787786386.954265:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787786386.954275:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5232989680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686773632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787786386.954313:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787786386.964187:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5232989680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686773632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9903us (10071us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786386.964204:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1787786386.964416:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523b436d00 x1874629686773632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786386.964442:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b436d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686773632:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1787786387.049350:0:11470:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 19:19:45 (1787786385) === 00000100:00100000:0.0:1787786387.290941:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786387.291221:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667863808 00000100:00100000:1.0:1787786387.291241:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667863808 00000100:00100000:1.0:1787786387.291317:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 14 00000100:00100000:1.0:1787786387.291328:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+6:2363:x1874629667863808:12345-192.168.204.34@tcp:41:mkdir.0 00000004:00000024:1.0:1787786387.291383:0:8713:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:3.0:1787786387.291547:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787786387.291727:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+6:2363:x1874629667863808:12345-192.168.204.34@tcp:41:mkdir.0 Request processed in 401us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786387.291737:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 14 00000100:00100000:1.0:1787786387.293555:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786387.293875:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667863936 00000100:00100000:3.0:1787786387.293885:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667863936 00000100:00100000:3.0:1787786387.294226:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 0 00000100:00100000:3.0:1787786387.294237:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5232988f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:173d08e0-0e54-474e-858e-1679cd38cf14+6:9702:x1874629667863936:12345-192.168.204.34@tcp:700:mkdir.0 00000100:00100000:3.0:1787786387.294336:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5232988f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:173d08e0-0e54-474e-858e-1679cd38cf14+6:9702:x1874629667863936:12345-192.168.204.34@tcp:700:mkdir.0 Request processed in 101us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786387.294343:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 0 00000100:00100000:1.0:1787786387.298211:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786387.298375:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667864192 00000100:00100000:3.0:1787786387.298388:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667864192 00000100:00100000:3.0:1787786387.298541:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 15 00000100:00100000:3.0:1787786387.298553:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5232989e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+6:9702:x1874629667864192:12345-192.168.204.34@tcp:36:mkdir.0 00010000:00010000:3.0:1787786387.298635:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786387.302195:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201677400/0x450132973bff20c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75212c expref: 6 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.302227:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b52100f1d00) 00010000:00010000:3.0:1787786387.302256:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787786387.302605:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff21e2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.302619:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff21e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.302629:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff21e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.302667:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7000/0x450132973bff21e9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.302675:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7000/0x450132973bff21e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.302682:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7000/0x450132973bff21e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786387.305093:0:7644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787786387.305113:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff21e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.305132:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff21e2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.305139:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff21e2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.305145:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb6200 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786387.305150:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff21e2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.305158:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff21e2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.305174:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5204e6fc00) 00010000:00010000:3.0:1787786387.305177:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786387.305181:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff21e2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.305188:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff21e2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787786387.305206:0:7644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e89a390 reply state 000000001b986ae5 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7000/0x450132973bff21e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786387.305214:0:7644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787786387.305315:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5232989e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+7:9702:x1874629667864192:12345-192.168.204.34@tcp:36:mkdir.0 Request processed in 6761us (7115us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787786387.305324:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 15 00010000:00010000:0.0:1787786387.312237:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7000/0x450132973bff21e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.312257:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7000/0x450132973bff21e9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.312266:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7000/0x450132973bff21e9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.312272:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7000 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786387.312282:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7000/0x450132973bff21e9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.312290:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7000/0x450132973bff21e9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.312310:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8b5204e6f400) 00010000:00010000:0.0:1787786387.312313:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786387.312317:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7000/0x450132973bff21e9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.312323:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7000/0x450132973bff21e9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786387.335337:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786387.335824:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667864320 00000100:00100000:3.0:1787786387.335834:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667864320 00000100:00100000:3.0:1787786387.335908:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 16 00000100:00100000:3.0:1787786387.335918:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523298b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+6:9704:x1874629667864320:12345-192.168.204.34@tcp:101:chmod.0 00010000:00010000:3.0:1787786387.335939:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786387.335971:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff21f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7521b1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.336039:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff21f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.336052:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff21f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.336062:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff21f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786387.336119:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787786387.336123:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787786387.336169:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff21f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.336196:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff21f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521b1 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.336215:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff21f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521b1 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.336223:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5204e6fc00) 00010000:00010000:3.0:1787786387.336226:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787786387.336230:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb7e00, rc 0) 00000100:00100000:3.0:1787786387.339447:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523298b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+7:9704:x1874629667864320:12345-192.168.204.34@tcp:101:chmod.0 Request processed in 380us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786387.339475:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 16 00000100:00100000:1.0:1787786387.348197:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786387.348491:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667864576 00000100:00100000:2.0:1787786387.348501:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667864576 00000100:00100000:2.0:1787786387.348620:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 17 00000100:00100000:2.0:1787786387.348631:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5232988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+7:9704:x1874629667864576:12345-192.168.204.34@tcp:36:chmod.0 00010000:00010000:2.0:1787786387.348685:0:8713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787786387.348712:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff21f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521b1 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.348731:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5204e6fc00) 00010000:00010000:2.0:1787786387.348741:0:8713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787786387.348765:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff21fe lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.348778:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff21fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.348880:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff21fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787786387.349216:0:8713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f81a526a reply state 000000002bf5ecb3 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff21fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786387.349226:0:8713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787786387.349238:0:8713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787786387.349311:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5232988000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+8:9704:x1874629667864576:12345-192.168.204.34@tcp:36:chmod.0 Request processed in 683us (1123us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787786387.349328:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 17 00010000:00010000:0.0:1787786387.353332:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff21fe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.353356:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff21fe lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.353386:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff21fe lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.353393:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aada00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786387.353399:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff21fe lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.353409:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff21fe lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.353431:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5210c81100) 00010000:00010000:0.0:1787786387.353435:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787786387.353440:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff21fe lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.353464:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff21fe lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786387.373414:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786387.373541:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667864704 00000100:00100000:3.0:1787786387.373555:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667864704 00000100:00100000:3.0:1787786387.373635:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 18 00000100:00100000:3.0:1787786387.373649:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5232988780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+7:9705:x1874629667864704:12345-192.168.204.34@tcp:101:chown.0 00010000:00010000:3.0:1787786387.373682:0:7644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786387.373711:0:7644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2205 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7521b8 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.373850:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff220c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.373869:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff220c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.373884:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff220c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786387.373989:0:7644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787786387.373994:0:7644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787786387.374051:0:7644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff220c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.374089:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2205 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521b8 expref: 9 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.374110:0:7644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff220c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521b8 expref: 8 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.374147:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5204e6fe00) 00010000:00010000:3.0:1787786387.374151:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787786387.374154:0:7644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb6800, rc 0) 00000100:00100000:3.0:1787786387.374230:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5232988780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+8:9705:x1874629667864704:12345-192.168.204.34@tcp:101:chown.0 Request processed in 584us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786387.374238:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 18 00000100:00100000:2.0:1787786387.384207:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786387.384381:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667864832 00000100:00100000:3.0:1787786387.384416:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667864832 00000100:00100000:3.0:1787786387.384509:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 19 00000100:00100000:3.0:1787786387.384522:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5233338780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+8:9705:x1874629667864832:12345-192.168.204.34@tcp:101:chown.0 00010000:00010000:3.0:1787786387.384552:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786387.384581:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2213 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7521bf expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.384669:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff221a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.384686:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff221a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.384699:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff221a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.384719:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff2221 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.384727:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff2221 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.384762:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff2221 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.384939:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7000/0x450132973bff2228 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.384948:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7000/0x450132973bff2228 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.384956:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7000/0x450132973bff2228 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786387.385022:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787786387.385027:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787786387.385056:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7000/0x450132973bff2228 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.385072:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff221a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.385080:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff221a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.385087:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff221a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.385094:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7600 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786387.385100:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff221a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.385108:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff221a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.385132:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5204e6fe00) 00010000:00010000:3.0:1787786387.385135:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786387.385141:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff221a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.385148:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff221a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.385164:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff2221 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.385170:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff2221 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.385176:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff2221 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.385180:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7e00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786387.385183:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff2221 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.385188:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff2221 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.385550:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8b5204e6f000) 00010000:00010000:3.0:1787786387.385553:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786387.385557:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff2221 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.385562:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff2221 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.385620:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2213 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521bf expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.385636:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7000/0x450132973bff2228 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521bf expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.385643:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b5204e6f200) 00010000:00010000:3.0:1787786387.385645:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787786387.385647:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb7000, rc 0) 00000100:00100000:2.0:1787786387.386510:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5233338780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+9:9705:x1874629667864832:12345-192.168.204.34@tcp:101:chown.0 Request processed in 1979us (2327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786387.386524:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 19 00000100:00100000:1.0:1787786387.394623:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786387.394980:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667865088 00000100:00100000:2.0:1787786387.394993:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667865088 00000100:00100000:2.0:1787786387.395141:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 20 00000100:00100000:2.0:1787786387.395154:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5232898780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+9:9705:x1874629667865088:12345-192.168.204.34@tcp:36:chown.0 00010000:00010000:2.0:1787786387.395345:0:8713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787786387.395394:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7000/0x450132973bff2228 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521bf expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.395429:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b5204e6f200) 00010000:00010000:2.0:1787786387.395443:0:8713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787786387.395599:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff222f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.395617:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff222f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.395629:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff222f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787786387.489784:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1787786387.490048:0:8713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a42fcb11 reply state 00000000ff403285 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff222f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786387.490067:0:8713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787786387.490690:0:8713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:1.0:1787786387.491036:0:8713:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1787786387.491067:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5232898780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+7:9705:x1874629667865088:12345-192.168.204.34@tcp:36:chown.0 Request processed in 95907us (96452us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787786387.491079:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 20 00010000:00010000:0.0:1787786387.491197:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff222f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.491210:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff222f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.491218:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff222f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.491225:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aade00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786387.491231:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff222f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.491261:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff222f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.491282:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b5210c81e00) 00010000:00010000:0.0:1787786387.491285:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787786387.491291:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff222f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.491298:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff222f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786387.528778:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786387.528943:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667865216 00000100:00100000:3.0:1787786387.528968:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667865216 00000100:00100000:3.0:1787786387.529053:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 21 00000100:00100000:3.0:1787786387.529066:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b434780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+6:9706:x1874629667865216:12345-192.168.204.34@tcp:101:touch.500 00010000:00010000:3.0:1787786387.529110:0:7644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786387.529141:0:7644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2236 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7521c6 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787786387.535580:0:7644:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 5671us 00010000:00010000:2.0:1787786387.591998:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff223d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.592049:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff223d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.592063:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff223d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.592083:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff2244 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.592090:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff2244 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.592096:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff2244 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.592682:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff224b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.592694:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff224b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.592702:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff224b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786387.592840:0:7644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787786387.592845:0:7644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787786387.592974:0:7644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff224b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.592991:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff223d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.593009:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff223d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.593017:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff223d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.593024:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aac200 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786387.593028:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff223d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.593037:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff223d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.593053:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5204e6fe00) 00010000:00010000:2.0:1787786387.593056:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786387.593061:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff223d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.593067:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff223d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.593081:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff2244 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.593087:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff2244 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.593092:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff2244 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.593096:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aad400 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786387.593106:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff2244 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.593113:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff2244 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.593121:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8b5210c81c00) 00010000:00010000:2.0:1787786387.593124:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786387.593126:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff2244 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.593132:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff2244 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.593175:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2236 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521c6 expref: 8 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.593192:0:7644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff224b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521c6 expref: 7 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.593200:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b5210c81700) 00010000:00010000:2.0:1787786387.593202:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787786387.593205:0:7644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aade00, rc 0) 00000100:00100000:2.0:1787786387.593305:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b434780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+7:9706:x1874629667865216:12345-192.168.204.34@tcp:101:touch.500 Request processed in 64240us (64541us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786387.593316:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 21 00000100:00100000:1.0:1787786387.596249:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786387.596332:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667865472 00000100:00100000:2.0:1787786387.596345:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667865472 00000100:00100000:2.0:1787786387.596419:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 22 00000100:00100000:2.0:1787786387.596432:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5232898b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+7:9706:x1874629667865472:12345-192.168.204.34@tcp:101:touch.500 00010000:00010000:2.0:1787786387.596478:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786387.596503:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2252 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7521cd expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.597026:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2259 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.597046:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2259 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.597060:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2259 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.600127:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2260 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.600159:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2260 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.600175:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2260 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787786387.602073:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1787786387.603199:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ca00/0x450132973bff2267 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786387.603227:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ca00/0x450132973bff2267 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786387.603242:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ca00/0x450132973bff2267 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786387.603302:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2259 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786387.603310:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2259 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786387.603318:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2259 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786387.603325:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aada00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786387.603330:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2259 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786387.603339:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2259 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786387.603355:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b5210c81700) 00010000:00010000:1.0:1787786387.603359:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787786387.603376:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2259 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786387.603384:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2259 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787786387.603398:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000018e54c10 reply state 000000007dfcc811 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2260 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786387.603408:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787786387.603463:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2252 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521cd expref: 10 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786387.603480:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ca00/0x450132973bff2267 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521cd expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786387.603488:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8b5222ae8400) 00010000:00010000:1.0:1787786387.603491:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787786387.603494:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912ca00, rc 0) 00000100:00100000:1.0:1787786387.603598:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5232898b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+10:9706:x1874629667865472:12345-192.168.204.34@tcp:101:touch.500 Request processed in 7168us (7363us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1787786387.603608:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 22 00010000:00010000:0.0:1787786387.614684:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2260 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.614708:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2260 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.614717:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2260 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.614749:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912dc00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786387.614757:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2260 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.614767:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2260 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.614935:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x3b9b2d99 (ffff8b5222ae8d00) 00010000:00010000:0.0:1787786387.614940:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786387.614947:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2260 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.614954:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2260 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786387.618053:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786387.618186:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667865728 00000100:00100000:2.0:1787786387.618199:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667865728 00000100:00100000:2.0:1787786387.618280:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 23 00000100:00100000:2.0:1787786387.618293:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5232898f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+9:9706:x1874629667865728:12345-192.168.204.34@tcp:36:touch.500 00010000:00010000:2.0:1787786387.618384:0:8713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787786387.618420:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ca00/0x450132973bff2267 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521cd expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.618443:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8b5222ae8400) 00010000:00010000:2.0:1787786387.618456:0:8713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787786387.618515:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff2275 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.618529:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff2275 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.618540:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff2275 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787786387.621966:0:8713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000089db5b62 reply state 000000002ec5c4b4 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff2275 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786387.621986:0:8713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787786387.622126:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5232898f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+10:9706:x1874629667865728:12345-192.168.204.34@tcp:36:touch.500 Request processed in 3832us (4084us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787786387.622136:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 23 00010000:00010000:0.0:1787786387.628170:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff2275 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786387.628187:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00010000:00010000:0.0:1787786387.628198:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff2275 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.628210:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff2275 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.628219:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aad400 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786387.628225:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff2275 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.628235:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff2275 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.628293:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8b5210c81c00) 00010000:00010000:0.0:1787786387.628296:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786387.628304:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff2275 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786387.628306:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667865856 00010000:00010000:0.0:1787786387.628318:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff2275 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786387.628321:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667865856 00000100:00100000:2.0:1787786387.628398:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 24 00000100:00100000:2.0:1787786387.628413:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103b78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+9:9706:x1874629667865856:12345-192.168.204.34@tcp:101:touch.500 00010000:00010000:2.0:1787786387.628439:0:7644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786387.628463:0:7644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff227c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7521d4 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.628527:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff227c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521d4 expref: 10 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.628542:0:7644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff227c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521d4 expref: 10 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.628562:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8b5210c81e00) 00010000:00010000:2.0:1787786387.628565:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787786387.628569:0:7644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aac200, rc 0) 00000100:00100000:2.0:1787786387.628633:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103b78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+10:9706:x1874629667865856:12345-192.168.204.34@tcp:101:touch.500 Request processed in 224us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786387.628641:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 24 00000100:00100000:1.0:1787786387.635673:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786387.636231:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667865984 00000100:00100000:3.0:1787786387.636262:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667865984 00000100:00100000:3.0:1787786387.636315:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 16 00000100:00100000:3.0:1787786387.636323:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523289a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2361:x1874629667865984:12345-192.168.204.34@tcp:8:touch.500 00010000:00080000:3.0:1787786387.636355:0:8126:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 173d08e0-0e54-474e-858e-1679cd38cf14@192.168.204.34@tcp t0 exp 0000000000000000 cur 313 last 0 00000020:00000080:3.0:1787786387.636392:0:8126:0:(genops.c:1385:class_connect()) connect: client 173d08e0-0e54-474e-858e-1679cd38cf14, cookie 0x450132973bff2283 00002000:00100000:3.0:1787786387.636404:0:8126:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 173d08e0-0e54-474e-858e-1679cd38cf14/ffff8b5237c43800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113935 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787786387.636427:0:8126:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787786387.636655:0:8126:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787786387.636687:0:8126:0:(import.c:65:import_set_state_nolock()) ffff8b5237c47800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787786387.636773:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523289a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+6:2361:x1874629667865984:12345-192.168.204.34@tcp:8:touch.500 Request processed in 449us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786387.636782:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 16 00000100:00100000:1.0:1787786387.639719:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786387.639831:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667866112 00000100:00100000:3.0:1787786387.639842:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667866112 00000100:00100000:3.0:1787786387.639933:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 17 00000100:00100000:3.0:1787786387.639944:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5232899680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:173d08e0-0e54-474e-858e-1679cd38cf14+6:0:x1874629667866112:12345-192.168.204.34@tcp:2:touch.500 00000100:00080000:1.0:1787786387.641241:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787786387.738278:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:3.0:1787786387.738298:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 173d08e0-0e54-474e-858e-1679cd38cf14 00000100:00100000:2.0:1787786387.738655:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5232899680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:173d08e0-0e54-474e-858e-1679cd38cf14+5:0:x1874629667866112:12345-192.168.204.34@tcp:2:touch.500 Request processed in 98704us (98937us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787786387.738667:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 17 00000100:00100000:1.0:1787786387.741274:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786387.741378:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667866368 00000100:00100000:2.0:1787786387.741390:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667866368 00000100:00100000:2.0:1787786387.741459:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 2 00000100:00100000:2.0:1787786387.741482:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523289a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+10:9706:x1874629667866368:12345-192.168.204.34@tcp:35:touch.500 00000100:00100000:2.0:1787786387.741892:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523289a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+11:9706:x1874629667866368:12345-192.168.204.34@tcp:35:touch.500 Request processed in 411us (627us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787786387.741901:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 2 00000100:00100000:0.0:1787786387.757695:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786387.757970:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667866496 00000100:00100000:1.0:1787786387.757981:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667866496 00000100:00100000:1.0:1787786387.758042:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 25 00000100:00100000:1.0:1787786387.758077:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+11:9707:x1874629667866496:12345-192.168.204.34@tcp:101:rm.0 00010000:00010000:1.0:1787786387.758105:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786387.758127:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201677400/0x450132973bff228a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7521db expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786387.758198:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676000/0x450132973bff2291 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786387.758212:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676000/0x450132973bff2291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786387.758225:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676000/0x450132973bff2291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787786387.758290:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787786387.758294:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787786387.758340:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676000/0x450132973bff2291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786387.758367:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201677400/0x450132973bff228a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521db expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786387.758386:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676000/0x450132973bff2291 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521db expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786387.758394:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b5210c81700) 00010000:00010000:1.0:1787786387.758397:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787786387.758633:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5201676000, rc 0) 00000100:00100000:1.0:1787786387.758706:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+12:9707:x1874629667866496:12345-192.168.204.34@tcp:101:rm.0 Request processed in 632us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786387.758724:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 25 00000100:00100000:1.0:1787786387.763261:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786387.763354:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667866752 00000100:00100000:0.0:1787786387.763365:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667866752 00000100:00100000:0.0:1787786387.763436:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 26 00000100:00100000:0.0:1787786387.763454:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523289b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+12:9707:x1874629667866752:12345-192.168.204.34@tcp:101:rm.0 00010000:00010000:0.0:1787786387.763474:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786387.763497:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2298 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7521e2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787786387.763614:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787786387.764231:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2298 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521e2 expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.764250:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5204e6fe00) 00010000:00010000:0.0:1787786387.764253:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787786387.764259:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2298 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521e2 expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.764273:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912dc00, rc 0) 00000100:00100000:0.0:1787786387.764536:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523289b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+13:9707:x1874629667866752:12345-192.168.204.34@tcp:101:rm.0 Request processed in 1083us (1284us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1787786387.764552:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 26 00000100:00100000:2.0:1787786387.771691:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786387.771747:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667866880 00000100:00100000:0.0:1787786387.771758:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667866880 00000100:00100000:0.0:1787786387.771835:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 3 00000100:00100000:0.0:1787786387.771847:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523333b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+13:9707:x1874629667866880:12345-192.168.204.34@tcp:37:rm.0 00000100:00100000:0.0:1787786387.778360:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523333b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+13:9707:x1874629667866880:12345-192.168.204.34@tcp:37:rm.0 Request processed in 6503us (6668us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786387.778374:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 3 00000100:00100000:0.0:1787786387.782383:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786387.782634:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667867136 00000100:00100000:2.0:1787786387.782645:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667867136 00000100:00100000:2.0:1787786387.782745:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 4 00000100:00100000:2.0:1787786387.782760:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52062fe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+13:9707:x1874629667867136:12345-192.168.204.34@tcp:35:rm.0 00000100:00100000:0.0:1787786387.783344:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52062fe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+14:9707:x1874629667867136:12345-192.168.204.34@tcp:35:rm.0 Request processed in 580us (966us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787786387.783354:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 4 00000100:00100000:2.0:1787786387.791179:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786387.791453:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667867392 00000100:00100000:3.0:1787786387.791463:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667867392 00000100:00100000:3.0:1787786387.791527:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 27 00000100:00100000:3.0:1787786387.791537:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523333b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+14:9707:x1874629667867392:12345-192.168.204.34@tcp:101:rm.0 00010000:00010000:3.0:1787786387.791564:0:7644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786387.791585:0:7644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff22a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7521e9 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.791718:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff22ad lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.791732:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff22ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.791743:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff22ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786387.791753:0:7644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787786387.793227:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff22a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521e9 expref: 17 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.793250:0:7644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff22ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521e9 expref: 16 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786387.793258:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b5210c81700) 00010000:00010000:2.0:1787786387.793261:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787786387.793263:0:7644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb7600, rc 0) 00000100:00100000:2.0:1787786387.795413:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523333b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+16:9707:x1874629667867392:12345-192.168.204.34@tcp:101:rm.0 Request processed in 3860us (4227us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787786387.795428:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 27 00000100:00100000:2.0:1787786387.802210:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786387.802671:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667867520 00000100:00100000:3.0:1787786387.802681:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667867520 00000100:00100000:3.0:1787786387.802831:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 28 00000100:00100000:3.0:1787786387.802854:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5233338b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+16:9707:x1874629667867520:12345-192.168.204.34@tcp:41:rm.0 00000004:00000024:3.0:1787786387.802935:0:8713:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1787786387.803026:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5233338b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+16:9707:x1874629667867520:12345-192.168.204.34@tcp:41:rm.0 Request processed in 185us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786387.803035:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 28 00000100:00100000:0.0:1787786387.810283:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786387.810381:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667867648 00000100:00100000:3.0:1787786387.810392:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667867648 00000100:00100000:3.0:1787786387.810466:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 29 00000100:00100000:3.0:1787786387.810477:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+16:9707:x1874629667867648:12345-192.168.204.34@tcp:101:rm.0 00010000:00010000:3.0:1787786387.810499:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786387.810520:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff22bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7521f0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.810590:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7800/0x450132973bff22c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.810617:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7800/0x450132973bff22c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.810627:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7800/0x450132973bff22c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.810642:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff22c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.810650:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff22c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.810657:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff22c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.810773:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff22d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.810782:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff22d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.810823:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff22d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786387.810849:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1787786387.810853:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787786387.810871:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff22d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.810882:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff22d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.810900:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7800/0x450132973bff22c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.810906:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7800/0x450132973bff22c2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.810912:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7800/0x450132973bff22c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.810931:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7800 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786387.810935:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7800/0x450132973bff22c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.810943:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7800/0x450132973bff22c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.810963:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b5210c81700) 00010000:00010000:3.0:1787786387.810966:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786387.810971:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7800/0x450132973bff22c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.810977:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7800/0x450132973bff22c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.810988:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff22c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.810994:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff22c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.811000:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff22c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.811012:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7a00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786387.811015:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff22c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.811021:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff22c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.811030:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x3b9b2d99 (ffff8b5204e6f000) 00010000:00010000:3.0:1787786387.811032:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786387.811035:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff22c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.811040:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff22c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.811070:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff22bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521f0 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.811082:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff22d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521f0 expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.811089:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8b5210c81e00) 00010000:00010000:3.0:1787786387.811092:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787786387.811094:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb7e00, rc 0) 00000100:00100000:3.0:1787786387.811163:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+17:9707:x1874629667867648:12345-192.168.204.34@tcp:101:rm.0 Request processed in 689us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786387.811171:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 29 00000100:00100000:2.0:1787786387.816754:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786387.816888:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667867904 00000100:00100000:0.0:1787786387.816898:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667867904 00000100:00100000:0.0:1787786387.816972:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 30 00000100:00100000:0.0:1787786387.816982:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523333ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+17:9707:x1874629667867904:12345-192.168.204.34@tcp:36:rm.0 00010000:00010000:0.0:1787786387.817038:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787786387.817080:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff22d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521f0 expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.817105:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff227c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521d4 expref: 16 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.817117:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8b5210c81e00) 00010000:00010000:0.0:1787786387.817151:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676000/0x450132973bff2291 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521db expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.817161:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b5210c81700) 00010000:00010000:0.0:1787786387.817164:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787786387.817186:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff22d7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.817201:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff22d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.817211:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff22d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.817226:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d600/0x450132973bff22de lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.817232:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d600/0x450132973bff22de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.817239:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d600/0x450132973bff22de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.817379:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff22e5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.817388:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff22e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.817406:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff22e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787786387.818217:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1787786387.818237:0:7644:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 314176445960ns, next at 315176443230ns, rc = 0 00010000:00010000:0.0:1787786387.818305:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff22ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.818318:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff22ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.818327:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff22ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.818335:0:7644:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff22ec lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.818341:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff22ec lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.818347:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff22ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.818375:0:7644:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787786387.818395:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff22e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.818402:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff22e5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.818408:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff22e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.818415:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912c000 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786387.818419:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff22e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.818436:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff22e5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.818448:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8b5222ae8d00) 00010000:00010000:0.0:1787786387.818450:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787786387.818454:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff22e5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.818460:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff22e5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.818477:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff22d7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.818484:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff22d7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.818489:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff22d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.818494:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912d200 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786387.818497:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff22d7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.818503:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff22d7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.818510:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b5210c81700) 00010000:00010000:0.0:1787786387.818513:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786387.818516:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff22d7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.818531:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff22d7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787786387.818543:0:7644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000080e95f77 reply state 0000000046df9ca9 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d600/0x450132973bff22de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786387.818551:0:7644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787786387.818647:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523333ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+16:9707:x1874629667867904:12345-192.168.204.34@tcp:36:rm.0 Request processed in 1663us (1900us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787786387.818656:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 30 00010000:00010000:3.0:1787786387.819126:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787786387.819141:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff22ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.819147:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912d400 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:3.0:1787786387.819151:0:7633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff22ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.819157:0:7633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff22ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.819167:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8b5222ae8d00) 00010000:00010000:3.0:1787786387.819170:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787786387.819173:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff22ec lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.819178:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff22ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.819192:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786387.819194:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786387.819196:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786387.821126:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d600/0x450132973bff22de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.821141:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d600/0x450132973bff22de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.821148:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d600/0x450132973bff22de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.821154:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912d600 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786387.821159:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d600/0x450132973bff22de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.821167:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d600/0x450132973bff22de lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.821182:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x3b9b2d99 (ffff8b5222ae8a00) 00010000:00010000:0.0:1787786387.821185:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786387.821188:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d600/0x450132973bff22de lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.821209:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d600/0x450132973bff22de lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x3b9b2d99 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786387.827214:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786387.827299:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667868160 00000100:00100000:0.0:1787786387.827310:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667868160 00000100:00100000:0.0:1787786387.827372:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 5 00000100:00100000:0.0:1787786387.827383:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523333a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+15:9707:x1874629667868160:12345-192.168.204.34@tcp:35:rm.0 00000100:00100000:0.0:1787786387.827674:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523333a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+16:9707:x1874629667868160:12345-192.168.204.34@tcp:35:rm.0 Request processed in 292us (469us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787786387.827683:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 5 00000100:00100000:2.0:1787786387.830905:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786387.831062:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667868416 00000100:00100000:3.0:1787786387.831072:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667868416 00000100:00100000:3.0:1787786387.831131:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 31 00000100:00100000:3.0:1787786387.831141:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+16:9707:x1874629667868416:12345-192.168.204.34@tcp:36:rm.0 00010000:00010000:3.0:1787786387.831200:0:8713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787786387.831229:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff22ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521e9 expref: 16 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.831251:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff224b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521c6 expref: 15 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.831274:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b5210c81700) 00010000:00010000:3.0:1787786387.831292:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff220c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521b8 expref: 14 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.831300:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5204e6fe00) 00010000:00010000:3.0:1787786387.831307:0:8713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787786387.831331:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff22f3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.831344:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff22f3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.831353:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff22f3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.831365:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff22fa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.831372:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff22fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.831379:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff22fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.831719:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7800/0x450132973bff2301 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.831728:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7800/0x450132973bff2301 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.831745:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7800/0x450132973bff2301 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786387.832390:0:8713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787786387.832408:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7800/0x450132973bff2301 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.832416:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7800/0x450132973bff2301 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.832422:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7800/0x450132973bff2301 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.832428:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7800 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786387.832433:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7800/0x450132973bff2301 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.832440:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7800/0x450132973bff2301 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.832451:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8b5204e6f600) 00010000:00010000:3.0:1787786387.832455:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1787786387.832459:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7800/0x450132973bff2301 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.832465:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7800/0x450132973bff2301 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.832487:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff22f3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.832493:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff22f3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.832507:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff22f3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.832512:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7c00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786387.832515:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff22f3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.832521:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff22f3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.832530:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5204e6f000) 00010000:00010000:3.0:1787786387.832532:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786387.832535:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff22f3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786387.832541:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff22f3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787786387.832554:0:8713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f0196670 reply state 00000000dbd14032 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff22fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786387.832564:0:8713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787786387.832664:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+15:9707:x1874629667868416:12345-192.168.204.34@tcp:36:rm.0 Request processed in 1521us (1765us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787786387.832673:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 31 00010000:00010000:0.0:1787786387.835387:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff22fa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.835403:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff22fa lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.835411:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff22fa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.835418:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7a00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786387.835423:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff22fa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.835430:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff22fa lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.835455:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8b5204e6f100) 00010000:00010000:0.0:1787786387.835459:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786387.835480:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff22fa lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.835487:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff22fa lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786387.914020:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786388.405534:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786388.405580:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786388.405625:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786388.405654:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667868672 00000100:00100000:2.0:1787786388.405668:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786388.405670:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667868672 00000100:00100000:1.0:1787786388.405758:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667868928 00000100:00100000:1.0:1787786388.405761:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667868928 00000100:00100000:1.0:1787786388.405847:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 87 00000100:00100000:1.0:1787786388.405859:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+14:2362:x1874629667868672:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1787786388.405900:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667868544 00000100:00100000:3.0:1787786388.405911:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667868544 00000100:00100000:1.0:1787786388.405993:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+14:2362:x1874629667868672:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 130us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786388.405999:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 243 00000100:00100000:3.0:1787786388.406022:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2362:x1874629667868544:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1787786388.406161:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2362:x1874629667868544:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 145us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786388.406169:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 243 00000100:00100000:3.0:1787786388.406209:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667868800 00000100:00100000:3.0:1787786388.406212:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667868800 00000100:00100000:3.0:1787786388.406249:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 51 00000100:00100000:3.0:1787786388.406256:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+5:2362:x1874629667868800:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1787786388.406292:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+5:2362:x1874629667868800:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 37us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786388.406298:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 51 00000100:00100000:0.0:1787786388.410831:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 88 00000100:00100000:1.0:1787786388.411038:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 87 00000100:00080000:1.0:1787786388.411100:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787786388.411284:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e407027-7940-45d9-87d7-56031cd08b7a+5:2362:x1874629667868928:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1787786388.411761:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e407027-7940-45d9-87d7-56031cd08b7a+5:2362:x1874629667868928:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 903us (6171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786388.411774:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 88 00010000:00010000:2.0:1787786388.940363:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786389.967714:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787786390.539127:0:7063:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 316897333499ns, next at 317897331254ns, rc = 0 00000100:00100000:2.0:1787786390.539131:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787786390.539156:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686773760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787786390.539229:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786390.539344:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686773760 00000100:00100000:3.0:1787786390.539352:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686773760 00000100:00100000:3.0:1787786390.539420:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787786390.539430:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bffad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686773760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787786390.539466:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787786390.539513:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bffad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686773760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786390.539522:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1787786390.539592:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787786390.539689:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5103b78b40 x1874629686773760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786390.539708:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686773760:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787786390.986074:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786391.562134:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874629686774144:0@lo:400:kworker.0 00000100:00100000:3.0:1787786391.562232:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786391.562300:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787786391.562307:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686774016:0@lo:400:kworker.0 00000100:00100000:3.0:1787786391.562330:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786391.562360:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc98f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686774528:0@lo:400:kworker.0 00000100:00100000:3.0:1787786391.562384:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786391.562414:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686774144 00000100:00100000:3.0:1787786391.562421:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686774144 00000100:00100000:0.0:1787786391.562590:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc9b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686774272:0@lo:400:kworker.0 00000100:00100000:0.0:1787786391.562620:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786391.562657:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787786391.562663:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103b79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686773888:0@lo:400:kworker.0 00000100:00100000:0.0:1787786391.562690:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786391.562723:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc98780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874629686774400:0@lo:400:kworker.0 00000100:00100000:3.0:1787786391.562734:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686774016 00000100:00100000:3.0:1787786391.562737:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686774016 00000100:00100000:0.0:1787786391.562744:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786391.562758:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686774400 00000100:00100000:3.0:1787786391.562761:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686774400 00000100:00100000:0.0:1787786391.562774:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787786391.562784:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874629686774144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786391.562865:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787786391.562872:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686774016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786391.562873:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874629686774144:12345-0@lo:400:kworker.0 Request processed in 92us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786391.562891:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787786391.562908:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787786391.562914:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686774016:12345-0@lo:400:kworker.0 Request processed in 43us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786391.562914:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b435a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874629686774400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786391.562920:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787786391.562956:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b435a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874629686774400:12345-0@lo:400:kworker.0 Request processed in 42us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786391.562957:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686774528 00000100:00100000:3.0:1787786391.562960:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686774528 00000100:00100000:0.0:1787786391.562962:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787786391.562979:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686773888 00000100:00100000:0.0:1787786391.562982:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686773888 00000100:00100000:3.0:1787786391.562983:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686774272 00000100:00100000:3.0:1787786391.562984:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686774272 00000100:00100000:3.0:1787786391.563000:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787786391.563002:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787786391.563006:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686774528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786391.563007:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3311:x1874629686773888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786391.563035:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3311:x1874629686773888:12345-0@lo:400:kworker.0 Request processed in 27us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786391.563041:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1787786391.563076:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787786391.563083:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686774272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786391.563111:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b437480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686774272:12345-0@lo:400:kworker.0 Request processed in 29us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786391.563117:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787786391.563150:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b79e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686773888:0@lo:400:kworker.0 00000100:00080000:2.0:1787786391.563157:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787786391.563161:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787786391.563163:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc98780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874629686774400:0@lo:400:kworker.0 00010000:00080000:0.0:1787786391.563175:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bc9b840 x1874629686774272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786391.563185:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc9b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686774272:0@lo:400:kworker.0 00000100:00100000:3.0:1787786391.563288:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686774528:12345-0@lo:400:kworker.0 Request processed in 281us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786391.563296:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787786391.563358:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103b78b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686774016:0@lo:400:kworker.0 00010000:00080000:1.0:1787786391.563369:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bc98f00 x1874629686774528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786407 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786391.563377:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc98f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686774528:0@lo:400:kworker.0 00000100:00100000:1.0:1787786391.563387:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc983c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874629686774144:0@lo:400:kworker.0 00010000:00010000:0.0:1787786392.020080:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786392.074404:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787786392.074431:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b436d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686774656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787786392.074497:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786392.074569:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686774656 00000100:00100000:0.0:1787786392.074577:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686774656 00000100:00100000:0.0:1787786392.074625:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787786392.074635:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686774656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787786392.074676:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787786392.074719:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686774656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786392.074727:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1787786392.074768:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523b436d00 x1874629686774656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786392.074821:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b436d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686774656:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1787786392.124779:0:11621:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:2.0:1787786392.692183:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:2.0:1787786392.692205:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:2.0:1787786392.692238:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:2.0:1787786392.692245:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:0.0:1787786392.696179:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686774784:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1787786392.696282:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786392.696392:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686774784 00000100:00100000:0.0:1787786392.696401:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686774784 00000100:00100000:0.0:1787786392.696492:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787786392.696505:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc98f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686774784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787786392.696550:0:6700:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1787786392.696594:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a8f7493, atime: 0x6a8f7493, ctime: 0x6a8f7493, blocks: 0x1 00010000:00010000:0.0:1787786392.696604:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b874d3f2/0x450132973bff2308 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786392.696626:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=319s v=(0 0) 00010000:00010000:0.0:1787786392.696631:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787786392.696640:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b874d3f2/0x450132973bff2308 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787786392.696684:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787786392.696693:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b874d3f2/0x450132973bff2308 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786392.696705:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b874d3f2/0x450132973bff2308 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786392.696713:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b874d3f2/0x450132973bff2308 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786392.696740:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787786392.696779:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787786392.696809:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b874d3f2/0x450132973bff2308 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786392.696819:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912da00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:1.0:1787786392.696824:0:7633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b874d3f2/0x450132973bff2308 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786392.696840:0:7633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b874d3f2/0x450132973bff2308 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786392.696873:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b874d3f2/0x450132973bff2308 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786392.696881:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b874d3f2/0x450132973bff2308 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786392.696901:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786392.696903:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786392.696905:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786392.698053:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc98f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1874629686774784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1543us (1763us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787786392.698065:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:1.0:1787786392.698093:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b523b4d6580/2, rc 0, transno 4294967300 00000100:00100000:1.0:1787786392.698100:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686774784:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1787786393.033924:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787786393.202290:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000020:00000080:2.0:1787786393.279348:0:11673:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffbdc88970 20000000:00000080:2.0:1787786393.279376:0:11673:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8b523bc2f000 uarg=0000000000000000 20000000:01000000:2.0:1787786393.279426:0:11673:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787786393.279435:0:11673:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787786393.279441:0:11673:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1787786393.280744:0:11674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1787786393.281316:0:11673:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1787786393.292237:0:11673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1787786393.292468:0:11673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1787786393.292549:0:11673:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1787786393.292571:0:11673:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787786393.292591:0:11673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b5237aad000/0x450132973bff230f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786393.292626:0:11673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b5237aacc00/0x450132973bff21b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff21aa expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786393.292634:0:11673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b5237aac400/0x450132973bff21bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff21b8 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786393.292640:0:11673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b5201677a00/0x450132973bff21cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff21c6 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786393.292650:0:11673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b523bcb6600/0x450132973bff21d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521a3 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786393.292657:0:11673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b5201676600/0x450132973bff21db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521aa expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786393.292665:0:11673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b5237aad000/0x450132973bff230f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786393.292707:0:11673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b5201676600/0x450132973bff21db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521aa expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786393.292724:0:11673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b5201676600/0x450132973bff21db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521aa expref: 12 pid: 5839 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786393.292740:0:11673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bff8b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1874629686774912:192.168.204.34@tcp:104: 00010000:00010000:2.0:1787786393.292912:0:11673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b523bcb6600/0x450132973bff21d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521a3 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786393.292920:0:11673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b523bcb6600/0x450132973bff21d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521a3 expref: 12 pid: 5841 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786393.292936:0:11673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bff8f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1874629686775040:192.168.204.34@tcp:104: 00010000:00010000:2.0:1787786393.292971:0:11673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b5201677a00/0x450132973bff21cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff21c6 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786393.292979:0:11673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b5201677a00/0x450132973bff21cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff21c6 expref: 18 pid: 5841 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786393.292988:0:11673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bffa580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1874629686775168:0@lo:104: 00000100:00100000:2.0:1787786393.293028:0:11673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787786393.293073:0:11673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b5237aac400/0x450132973bff21bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff21b8 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786393.293082:0:11673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b5237aac400/0x450132973bff21bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff21b8 expref: 18 pid: 5841 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786393.293091:0:11673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bffa1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1874629686775296:0@lo:104: 00000100:00100000:2.0:1787786393.293112:0:11673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787786393.293139:0:11673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b5237aacc00/0x450132973bff21b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff21aa expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786393.293147:0:11673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8b5237aacc00/0x450132973bff21b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff21aa expref: 18 pid: 5839 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786393.293156:0:11673:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bffbc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1874629686775424:0@lo:104: 00000100:00100000:2.0:1787786393.293187:0:11673:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786393.293218:0:7632:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787786393.293249:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686775168 00000100:00100000:1.0:1787786393.293259:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686775168 00000100:00100000:1.0:1787786393.293310:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686775296 00000100:00100000:1.0:1787786393.293314:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686775296 00000100:00100000:1.0:1787786393.293327:0:7632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686775424 00000100:00100000:1.0:1787786393.293329:0:7632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686775424 00000100:00100000:1.0:1787786393.293347:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787786393.293358:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+5:11673:x1874629686775168:12345-0@lo:104: 00010000:00010000:1.0:1787786393.293380:0:7632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6a00/0x450132973bff21c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff21cd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786393.293498:0:7632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787786393.293507:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+5:11673:x1874629686775168:12345-0@lo:104: Request processed in 150us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786393.293518:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787786393.293553:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787786393.293561:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bffb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+4:11673:x1874629686775296:12345-0@lo:104: 00010000:00010000:1.0:1787786393.293571:0:7632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff8b5201677c00/0x450132973bff21b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff21bf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786393.293615:0:7632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787786393.293621:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bffb840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+4:11673:x1874629686775296:12345-0@lo:104: Request processed in 62us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786393.293627:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787786393.293642:0:7632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787786393.293649:0:7632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf82850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+3:11673:x1874629686775424:12345-0@lo:104: 00010000:00010000:1.0:1787786393.293658:0:7632:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff8b520912c400/0x450132973bff21aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff21b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786393.293714:0:7632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787786393.293720:0:7632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf82850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+3:11673:x1874629686775424:12345-0@lo:104: Request processed in 72us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786393.293727:0:7632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1787786393.293779:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787786393.293786:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6a00/0x450132973bff21c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff21cd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786393.293841:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb6a00 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1787786393.293856:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6a00/0x450132973bff21c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff21cd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786393.293866:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6a00/0x450132973bff21c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff21cd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787786393.293875:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6a00/0x450132973bff21c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff21cd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787786393.293881:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787786393.293924:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6a00/0x450132973bff21c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff21cd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786393.293932:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787786393.293965:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6a00/0x450132973bff21c6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff21cd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786393.293974:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6a00/0x450132973bff21c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff21cd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786393.293989:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787786393.293993:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b5201677c00/0x450132973bff21b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff21bf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786393.294000:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5201677c00 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1787786393.294003:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b5201677c00/0x450132973bff21b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff21bf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786393.294023:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b5201677c00/0x450132973bff21b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff21bf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787786393.294030:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b5201677c00/0x450132973bff21b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff21bf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787786393.294035:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787786393.294051:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b5201677c00/0x450132973bff21b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff21bf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786393.294057:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787786393.294074:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b5201677c00/0x450132973bff21b8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff21bf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786393.294081:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b5201677c00/0x450132973bff21b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff21bf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786393.294092:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787786393.294095:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b520912c400/0x450132973bff21aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff21b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786393.294101:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912c400 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1787786393.294104:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b520912c400/0x450132973bff21aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff21b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786393.294111:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b520912c400/0x450132973bff21aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff21b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787786393.294117:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b520912c400/0x450132973bff21aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff21b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787786393.294130:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787786393.294146:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b520912c400/0x450132973bff21aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff21b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786393.294153:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787786393.294163:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b520912c400/0x450132973bff21aa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff21b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786393.294170:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b520912c400/0x450132973bff21aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff21b1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786393.294190:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786393.294194:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786393.294198:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786393.294209:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786393.294215:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786393.294232:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787786393.294249:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5232899a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686775552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787786393.294297:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786393.294347:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5232898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686775680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787786393.294373:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786393.294394:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787786393.294400:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523289b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686775808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787786393.294426:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786393.294458:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686775552 00000100:00100000:1.0:1787786393.294464:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686775552 00010000:00010000:1.0:1787786393.294494:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b5201677a00/0x450132973bff21cd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff21c6 expref: 19 pid: 5841 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786393.294496:0:8508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686775680 00000100:00100000:0.0:1787786393.294509:0:8508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686775680 00000100:00100000:1.0:1787786393.294548:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686775808 00010000:00010000:0.0:1787786393.294552:0:8508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b5237aac400/0x450132973bff21bf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff21b8 expref: 20 pid: 5841 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786393.294554:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686775808 00010000:00010000:1.0:1787786393.294578:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b5237aacc00/0x450132973bff21b1 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff21aa expref: 21 pid: 5839 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786393.294590:0:8508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787786393.294609:0:8508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328983c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+21:3311:x1874629686775552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787786393.294625:0:8508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787786393.294631:0:8508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b5201677a00/0x450132973bff21cd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff21c6 expref: 21 pid: 5841 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786393.294642:0:8508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b5201677a00/0x450132973bff21cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff21c6 expref: 21 pid: 5841 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786393.294674:0:8508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787786393.294734:0:8508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328983c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+21:3311:x1874629686775552:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786393.295378:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787786393.295393:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5232899e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+21:3313:x1874629686775680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787786393.295408:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786393.295425:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b5237aac400/0x450132973bff21bf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff21b8 expref: 21 pid: 5841 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786393.295437:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b5237aac400/0x450132973bff21bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff21b8 expref: 21 pid: 5841 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786393.295683:0:5833:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1787786393.295698:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:2.0:1787786393.295742:0:11673:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b521241e000 going to sleep for 11 seconds 00000100:00100000:2.0:1787786393.295781:0:11673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bff8b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1874629686774912:192.168.204.34@tcp:104: 00000100:00100000:2.0:1787786393.295816:0:11673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bff8f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1874629686775040:192.168.204.34@tcp:104: 00010000:00010000:2.0:1787786393.295827:0:11673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5201677a00/0x450132973bff21cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff21c6 expref: 21 pid: 5841 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786393.295843:0:11673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bffa580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1874629686775168:0@lo:104: 00000100:00100000:0.0:1787786393.295957:0:8508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787786393.295988:0:8508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787786393.296000:0:8508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5211bfa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3313:x1874629686775808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787786393.296016:0:8508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787786393.296022:0:8508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b5237aacc00/0x450132973bff21b1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff21aa expref: 19 pid: 5839 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786393.296061:0:11673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bffa1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1874629686775296:0@lo:104: 00000100:00100000:2.0:1787786393.296069:0:11673:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bffbc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11673:1874629686775424:0@lo:104: 00010000:00010000:0.0:1787786393.297156:0:8508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b5237aacc00/0x450132973bff21b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff21aa expref: 19 pid: 5839 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786393.297185:0:8508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5237aacc00/0x450132973bff21b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff21aa expref: 19 pid: 5839 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786393.297274:0:11673:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b5237aad000/0x450132973bff230f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786393.297342:0:8508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787786393.297465:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5237aac400/0x450132973bff21bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff21b8 expref: 18 pid: 5841 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786393.297485:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787786393.297543:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786393.297618:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5232898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686775680:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787786393.297896:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667869184 00000100:00100000:3.0:1787786393.297903:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667869184 00010000:00010000:3.0:1787786393.297946:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b523bcb6600/0x450132973bff21d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521a3 expref: 13 pid: 5841 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786393.298000:0:5833:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1787786393.298012:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 33 00000100:00100000:3.0:1787786393.298024:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bffbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2364:x1874629667869184:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787786393.298043:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786393.298051:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b523bcb6600/0x450132973bff21d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521a3 expref: 13 pid: 5841 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786393.298061:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b523bcb6600/0x450132973bff21d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521a3 expref: 13 pid: 5841 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786393.298078:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b523bcb6600/0x450132973bff21d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521a3 expref: 13 pid: 5841 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786393.298091:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786393.298469:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5232899e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:3313:x1874629686775680:12345-0@lo:103:ldlm_bl.0 Request processed in 3080us (4093us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786393.298478:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787786393.298531:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5232899a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686775552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787786393.298666:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786393.298755:0:5832:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1787786393.298768:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667869056 00000100:00100000:1.0:1787786393.298776:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667869056 00010000:00010000:1.0:1787786393.298833:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b5201676600/0x450132973bff21db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521aa expref: 13 pid: 5839 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786393.299262:0:5832:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1787786393.299272:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 34 00000100:00100000:1.0:1787786393.299281:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bffa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2365:x1874629667869056:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787786393.299296:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786393.299303:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b5201676600/0x450132973bff21db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521aa expref: 13 pid: 5839 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786393.299315:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b5201676600/0x450132973bff21db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521aa expref: 13 pid: 5839 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786393.299575:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5201676600/0x450132973bff21db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521aa expref: 13 pid: 5839 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786393.299594:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b5237aad000/0x450132973bff230f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786393.299602:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5237aad000/0x450132973bff230f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786393.299618:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b5237aad000/0x450132973bff230f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786393.299625:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b5237aad000/0x450132973bff230f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786393.299632:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b5237aad000/0x450132973bff230f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786393.299639:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b5237aad000/0x450132973bff230f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786393.299653:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aad000 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:1.0:1787786393.299657:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b5237aad000/0x450132973bff230f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786393.299666:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b5237aad000/0x450132973bff230f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786393.301093:0:8508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5211bfa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:3313:x1874629686775808:12345-0@lo:103:ldlm_bl.0 Request processed in 5091us (6658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786393.301105:0:8508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1787786393.301262:0:11673:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b5237aad000/0x450132973bff230f lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786393.301272:0:11673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b5237aad000/0x450132973bff230f lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786393.302291:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b5237aad000/0x450132973bff230f lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786393.302307:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5237aad000/0x450132973bff230f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786393.302329:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786393.302574:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bffa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+12:2365:x1874629667869056:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 3290us (3909us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786393.302584:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 34 00000100:00100000:3.0:1787786393.302718:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bffbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+11:2364:x1874629667869184:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 4681us (5168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786393.302734:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 33 00000100:00100000:1.0:1787786393.303980:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523289b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686775808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787786393.524304:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786393.524486:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786393.524616:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667869440 00000100:00100000:2.0:1787786393.524635:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667869440 00000100:00100000:1.0:1787786393.524658:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667869312 00000100:00100000:1.0:1787786393.524669:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667869312 00000100:00100000:1.0:1787786393.524786:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 92 00000100:00100000:2.0:1787786393.524839:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 54 00000100:00100000:2.0:1787786393.524868:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+5:2363:x1874629667869440:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786393.524967:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+5:2363:x1874629667869440:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 104us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786393.524975:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 54 00000100:00100000:1.0:1787786393.525077:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+5:2363:x1874629667869312:12345-192.168.204.34@tcp:400:kworker.0 00000100:00080000:0.0:1787786393.525081:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787786393.525089:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787786393.525169:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+5:2363:x1874629667869312:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 96us (883us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786393.526337:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 92 00000100:00100000:0.0:1787786393.529046:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786393.529144:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667869568 00000100:00100000:2.0:1787786393.529175:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667869568 00000100:00100000:2.0:1787786393.529270:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 93 00000100:00100000:2.0:1787786393.529281:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc98780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e407027-7940-45d9-87d7-56031cd08b7a+5:2363:x1874629667869568:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786393.529374:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc98780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e407027-7940-45d9-87d7-56031cd08b7a+5:2363:x1874629667869568:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 95us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786393.529382:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 93 00000100:00080000:0.0:1787786393.529641:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787786394.058083:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786394.744179:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786394.750643:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667869696 00000100:00100000:0.0:1787786394.750665:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667869696 00000100:00100000:0.0:1787786394.750775:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 245 00000100:00100000:0.0:1787786394.750807:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+11:5620:x1874629667869696:12345-192.168.204.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787786394.750843:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786394.750870:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b520912ca00/0x450132973bff2316 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7521f7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786394.750911:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b520912ca00/0x450132973bff2316 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521f7 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786394.750926:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b520912ca00/0x450132973bff2316 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521f7 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786394.750939:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912ca00, rc 0) 00000100:00100000:0.0:1787786394.751038:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+12:5620:x1874629667869696:12345-192.168.204.34@tcp:101:ll_cfg_requeue.0 Request processed in 251us (6873us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786394.751046:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 245 00000100:00100000:3.0:1787786394.756064:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786394.756262:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667869824 00000100:00100000:0.0:1787786394.756276:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667869824 00000100:00100000:0.0:1787786394.756357:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 246 00000100:00100000:0.0:1787786394.756370:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+12:5620:x1874629667869824:12345-192.168.204.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787786394.756770:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066ce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+12:5620:x1874629667869824:12345-192.168.204.34@tcp:501:ll_cfg_requeue.0 Request processed in 401us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786394.756779:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 246 00000100:00100000:2.0:1787786394.762106:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786394.762210:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667869952 00000100:00100000:3.0:1787786394.762223:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667869952 00000100:00100000:3.0:1787786394.762298:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 247 00000100:00100000:3.0:1787786394.762320:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+12:5620:x1874629667869952:12345-192.168.204.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787786394.762630:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066ce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+12:5620:x1874629667869952:12345-192.168.204.34@tcp:503:ll_cfg_requeue.0 Request processed in 319us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786394.762646:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 247 00000100:00100000:2.0:1787786394.770720:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786394.773366:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667870080 00000100:00100000:3.0:1787786394.773380:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667870080 00000100:00100000:3.0:1787786394.773460:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 248 00000100:00100000:3.0:1787786394.773476:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+12:9977:x1874629667870080:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787786394.773766:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+12:9977:x1874629667870080:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 294us (3058us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786394.773774:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 248 00000100:00100000:1.0:1787786394.784010:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786394.784270:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667870208 00000100:00100000:0.0:1787786394.784281:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667870208 00000100:00100000:0.0:1787786394.784366:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 249 00000100:00100000:0.0:1787786394.784392:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+12:9977:x1874629667870208:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787786394.784643:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+12:9977:x1874629667870208:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 253us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786394.784651:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 249 00000100:00100000:2.0:1787786394.790385:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786394.791390:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667870336 00000100:00100000:0.0:1787786394.791402:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667870336 00000100:00100000:0.0:1787786394.791471:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 250 00000100:00100000:0.0:1787786394.791481:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+12:5620:x1874629667870336:12345-192.168.204.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787786394.791499:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786394.791520:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b520912cc00/0x450132973bff231d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7521fe expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786394.791553:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b520912cc00/0x450132973bff231d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521fe expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786394.791565:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b520912cc00/0x450132973bff231d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521fe expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786394.791573:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912cc00, rc 0) 00000100:00100000:0.0:1787786394.791642:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:5620:x1874629667870336:12345-192.168.204.34@tcp:101:ll_cfg_requeue.0 Request processed in 163us (1268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786394.791649:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 250 00000100:00100000:2.0:1787786394.804029:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786394.804170:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667870464 00000100:00100000:3.0:1787786394.804180:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667870464 00000100:00100000:3.0:1787786394.804240:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 251 00000100:00100000:3.0:1787786394.804249:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:5620:x1874629667870464:12345-192.168.204.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787786394.804564:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:5620:x1874629667870464:12345-192.168.204.34@tcp:501:ll_cfg_requeue.0 Request processed in 315us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786394.804572:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 251 00000100:00100000:1.0:1787786394.814553:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786394.819459:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667870592 00000100:00100000:3.0:1787786394.819477:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667870592 00000100:00100000:3.0:1787786394.819599:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 252 00000100:00100000:3.0:1787786394.819611:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:5620:x1874629667870592:12345-192.168.204.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787786394.819882:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:5620:x1874629667870592:12345-192.168.204.34@tcp:503:ll_cfg_requeue.0 Request processed in 272us (5338us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786394.819890:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 252 00000100:00100000:2.0:1787786394.840989:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786394.841109:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667870720 00000100:00100000:0.0:1787786394.841120:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667870720 00000100:00100000:0.0:1787786394.841327:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 253 00000100:00100000:0.0:1787786394.841340:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:9980:x1874629667870720:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787786394.841616:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:9980:x1874629667870720:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 278us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786394.841625:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 253 00000100:00100000:2.0:1787786394.855329:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786394.855529:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667870848 00000100:00100000:3.0:1787786394.855543:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667870848 00000100:00100000:3.0:1787786394.855627:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 254 00000100:00100000:3.0:1787786394.855638:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:9980:x1874629667870848:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787786394.858753:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:9980:x1874629667870848:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 3105us (3422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786394.858768:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 254 00010000:00010000:1.0:1787786395.082786:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787786395.275712:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787786395.275739:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b5213768000 from 7 10000000:01000000:1.0:1787786395.275744:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787786395.275835:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b5201677a00/0x450132973bff2324 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786395.275848:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b5201677a00/0x450132973bff2324 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786395.275860:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b5201677a00/0x450132973bff2324 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786395.275887:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523289bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686775936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787786395.275967:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786395.276040:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52067ba780 going to sleep for 11 seconds 00000100:00100000:3.0:1787786395.276252:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686775936 00000100:00100000:3.0:1787786395.276261:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686775936 00000100:00100000:3.0:1787786395.276448:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787786395.276459:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52066cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:5843:x1874629686775936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787786395.276474:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786395.276489:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b523bcb6600/0x450132973bff232b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff2324 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786395.276512:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b523bcb6600/0x450132973bff232b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff2324 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786395.276524:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b523bcb6600/0x450132973bff232b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff2324 expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786395.276533:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb6600, rc 0) 00000100:00100000:3.0:1787786395.276596:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52066cec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:5843:x1874629686775936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786395.276603:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1787786395.276688:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523289bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686775936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787786395.276706:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b5201677a00/0x450132973bff2324 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff232b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786395.276715:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b5201677a00/0x450132973bff2324 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff232b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786395.276781:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc9b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686776064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787786395.276855:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786395.279913:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b446900 going to sleep for 11 seconds 00000100:00100000:1.0:1787786395.286145:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686776064 00000100:00100000:1.0:1787786395.286162:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686776064 00000100:00100000:1.0:1787786395.286242:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787786395.286254:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52063f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:5843:x1874629686776064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787786395.286631:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52063f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:5843:x1874629686776064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 378us (9774us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786395.286640:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1787786395.286718:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc9b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686776064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787786395.286781:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc9b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686776192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787786395.286912:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786395.286944:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b446900 going to sleep for 11 seconds 00000100:00100000:1.0:1787786395.287083:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686776192 00000100:00100000:1.0:1787786395.287089:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686776192 00000100:00100000:1.0:1787786395.287112:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787786395.287119:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52063f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:5843:x1874629686776192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787786395.287721:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52063f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:5843:x1874629686776192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786395.287732:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1787786395.287850:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc9b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686776192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787786395.290523:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc9b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:11688:1874629686776320:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787786395.290619:0:11688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786395.290673:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b446780 going to sleep for 11 seconds 00000100:00100000:3.0:1787786395.292959:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686776320 00000100:00100000:3.0:1787786395.292973:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686776320 00000100:00100000:3.0:1787786395.293039:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1787786395.293050:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:11688:x1874629686776320:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787786395.293344:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:11688:x1874629686776320:12345-0@lo:502:llog_process_th.0 Request processed in 294us (2724us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786395.293352:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1787786395.293431:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc9b840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:11688:1874629686776320:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787786395.293470:0:11688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787786395.293495:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786395.293498:0:11688:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787786395.293505:0:11688:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8b5213768000 00000020:00000080:2.0:1787786395.293509:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787786395.293615:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bffa580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:11688:1874629686776448:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787786395.293660:0:11688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786395.293702:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b521241e780 going to sleep for 11 seconds 00000100:00100000:1.0:1787786395.293709:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686776448 00000100:00100000:1.0:1787786395.293722:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686776448 00000100:00100000:1.0:1787786395.293765:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787786395.293774:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:11688:x1874629686776448:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787786395.293971:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:11688:x1874629686776448:12345-0@lo:502:llog_process_th.0 Request processed in 197us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786395.293978:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787786395.294970:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bffa580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:11688:1874629686776448:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787786395.295004:0:11688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787786395.295016:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786395.295017:0:11688:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787786395.295021:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787786395.295294:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787786395.295314:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787786395.295324:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b5201677a00/0x450132973bff2324 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff232b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786395.295343:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b5201677a00/0x450132973bff2324 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff232b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787786395.295353:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787786395.295356:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b5206233000 from 7 10000000:01000000:0.0:1787786395.295360:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787786395.295469:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff2332 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786395.295479:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff2332 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786395.295488:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff2332 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786395.295508:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc9b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686776576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787786395.295558:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786395.295595:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b446a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787786395.296028:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686776576 00000100:00100000:1.0:1787786395.296035:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686776576 00000100:00100000:1.0:1787786395.296074:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787786395.296081:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:5843:x1874629686776576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787786395.296094:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786395.296106:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5201676c00/0x450132973bff2339 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff2332 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786395.296129:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5201676c00/0x450132973bff2339 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff2332 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786395.296150:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5201676c00/0x450132973bff2339 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff2332 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786395.296160:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5201676c00, rc 0) 00000100:00100000:1.0:1787786395.296199:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:5843:x1874629686776576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786395.296206:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787786395.297063:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc9b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686776576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787786395.297081:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff2332 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2339 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786395.297091:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff2332 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff2339 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786395.297159:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc9b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686776704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787786395.297196:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786395.297230:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b446a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787786395.299324:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686776704 00000100:00100000:2.0:1787786395.299339:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686776704 00000100:00100000:2.0:1787786395.299422:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1787786395.299433:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:5843:x1874629686776704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787786395.299758:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:5843:x1874629686776704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 326us (2561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786395.299768:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1787786395.301112:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc9b840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686776704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787786395.301175:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686776832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787786395.301240:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786395.301277:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b520511f180 going to sleep for 11 seconds 00000100:00100000:2.0:1787786395.301538:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686776832 00000100:00100000:2.0:1787786395.301545:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686776832 00000100:00100000:2.0:1787786395.301596:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787786395.301605:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:5843:x1874629686776832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787786395.301914:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686776832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787786395.301939:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:5843:x1874629686776832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 187us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786395.301949:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1787786395.302327:0:11690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bffa580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:11690:1874629686776960:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787786395.302372:0:11690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786395.302446:0:11690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5212405780 going to sleep for 11 seconds 00000100:00100000:0.0:1787786395.306481:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686776960 00000100:00100000:0.0:1787786395.306494:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686776960 00000100:00100000:0.0:1787786395.306566:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787786395.306577:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:11690:x1874629686776960:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787786395.306922:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:11690:x1874629686776960:12345-0@lo:502:llog_process_th.0 Request processed in 345us (4547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786395.307200:0:11690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bffa580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:11690:1874629686776960:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787786395.307248:0:11690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787786395.307258:0:11690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787786395.307261:0:11690:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787786395.307268:0:11690:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8b5206233000 00000020:00000080:3.0:1787786395.307271:0:11690:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787786395.307367:0:11690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d7840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:11690:1874629686777088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787786395.307419:0:11690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786395.307455:0:11690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52086a9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787786395.307475:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686777088 00000100:00100000:3.0:1787786395.307479:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686777088 00000100:00100000:3.0:1787786395.307508:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787786395.307514:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:11690:x1874629686777088:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787786395.307657:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:11690:x1874629686777088:12345-0@lo:502:llog_process_th.0 Request processed in 141us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786395.307664:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1787786395.307709:0:11690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d7840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:11690:1874629686777088:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787786395.307728:0:11690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787786395.307732:0:11690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787786395.307734:0:11690:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787786395.307743:0:11690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787786395.307912:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 00000100:00100000:0.0:1787786395.308577:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 10000000:01000000:3.0:1787786395.311264:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787786395.311286:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff2332 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2339 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786395.311300:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff2332 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2339 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786395.311314:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787786395.311317:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b5207b73000 from 7 10000000:01000000:3.0:1787786395.311320:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787786395.311359:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7c00/0x450132973bff2340 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786395.311368:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7c00/0x450132973bff2340 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786395.311378:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7c00/0x450132973bff2340 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786395.311405:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686777216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787786395.311481:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786395.311526:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52086a9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787786395.312715:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686777216 00000100:00100000:0.0:1787786395.312726:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686777216 00000100:00100000:0.0:1787786395.312785:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787786395.312837:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:5843:x1874629686777216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787786395.312853:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786395.312868:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b520912c400/0x450132973bff2347 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff2340 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786395.312904:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b520912c400/0x450132973bff2347 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff2340 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786395.312916:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b520912c400/0x450132973bff2347 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff2340 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786395.312931:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912c400, rc 0) 00000100:00100000:0.0:1787786395.312992:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:5843:x1874629686777216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (1510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786395.312998:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1787786395.313296:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686777216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787786395.313315:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7c00/0x450132973bff2340 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2347 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786395.313324:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7c00/0x450132973bff2340 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff2347 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786395.313407:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686777344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787786395.313439:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786395.313463:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52086a9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787786395.313528:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686777344 00000100:00100000:0.0:1787786395.313534:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686777344 00000100:00100000:0.0:1787786395.313569:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1787786395.313585:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:5843:x1874629686777344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787786395.314119:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:5843:x1874629686777344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 534us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786395.314128:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787786395.314200:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686777344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787786395.314236:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686777472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787786395.314277:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786395.314307:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52086a9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787786395.314351:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686777472 00000100:00100000:1.0:1787786395.314357:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686777472 00000100:00100000:1.0:1787786395.314393:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787786395.314401:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:5843:x1874629686777472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787786395.314577:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:5843:x1874629686777472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786395.314584:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1787786395.316158:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d7840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:5843:1874629686777472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787786395.318310:0:11692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523289b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:11692:1874629686777600:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787786395.318397:0:11692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786395.318436:0:11692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52067ba0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787786395.318566:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686777600 00000100:00100000:0.0:1787786395.318573:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686777600 00000100:00100000:0.0:1787786395.318619:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1787786395.318628:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:11692:x1874629686777600:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787786395.318880:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:11692:x1874629686777600:12345-0@lo:502:llog_process_th.0 Request processed in 251us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786395.318889:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1787786395.319090:0:11692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523289b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:11692:1874629686777600:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787786395.319120:0:11692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787786395.319134:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787786395.319136:0:11692:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787786395.319144:0:11692:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8b5207b73000 00000020:00000080:3.0:1787786395.319147:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787786395.319608:0:11692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d7c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:11692:1874629686777728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787786395.319652:0:11692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786395.319679:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686777728 00000100:00100000:3.0:1787786395.319685:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686777728 00000100:00100000:3.0:1787786395.319708:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787786395.319716:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:11692:x1874629686777728:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787786395.319908:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:11692:x1874629686777728:12345-0@lo:502:llog_process_th.0 Request processed in 178us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786395.319915:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1787786395.320019:0:11692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52086a9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787786395.320034:0:11692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d7c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:11692:1874629686777728:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787786395.320058:0:11692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787786395.320063:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787786395.320065:0:11692:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787786395.320069:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787786395.320126:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787786395.320142:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787786395.320153:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7c00/0x450132973bff2340 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2347 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786395.320164:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7c00/0x450132973bff2340 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2347 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787786395.327114:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787786395.660308:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787786395.660333:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686777856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787786395.660421:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786395.661083:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686777856 00000100:00100000:0.0:1787786395.661093:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686777856 00000100:00100000:0.0:1787786395.661187:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787786395.661214:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686777856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787786395.661259:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787786395.661337:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686777856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786395.661345:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787786395.661520:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1787786395.661526:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b523b4d6580, transno 4294967300 00000100:00100000:3.0:1787786395.661549:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686777856:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787786395.662524:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787786396.106562:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787786396.362656:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787786396.682129:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787786396.682234:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787786396.682258:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523289b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686778368:0@lo:400:kworker.0 00000100:00100000:3.0:1787786396.682334:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786396.682411:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686778368 00000100:00100000:3.0:1787786396.682419:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686778368 00000100:00100000:3.0:1787786396.682486:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787786396.682496:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686778368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786396.682550:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686778368:12345-0@lo:400:kworker.0 Request processed in 54us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786396.682557:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787786396.682607:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523289b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686778368:0@lo:400:kworker.0 00000100:00100000:0.0:1787786396.682759:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52328992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686778112:0@lo:400:kworker.0 00000100:00100000:0.0:1787786396.682841:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786396.682864:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787786396.682871:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523289ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686778240:0@lo:400:kworker.0 00000100:00100000:0.0:1787786396.682915:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786396.682949:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686778112 00000100:00100000:0.0:1787786396.682954:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686778112 00000100:00100000:0.0:1787786396.682983:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686778240 00000100:00100000:0.0:1787786396.682986:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686778240 00000100:00100000:0.0:1787786396.683022:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787786396.683029:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686778112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786396.683067:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc9b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686778112:12345-0@lo:400:kworker.0 Request processed in 38us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786396.683074:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787786396.683086:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787786396.683092:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523333a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686778240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786396.683118:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523333a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686778240:12345-0@lo:400:kworker.0 Request processed in 26us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786396.683124:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787786396.683170:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523289ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686778240:0@lo:400:kworker.0 00000100:00100000:0.0:1787786396.683181:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52328992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686778112:0@lo:400:kworker.0 00000100:00080000:3.0:1787786396.683410:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787786396.685944:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5232899a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686777984:0@lo:400:kworker.0 00000100:00100000:2.0:1787786396.686035:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786396.686282:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686777984 00000100:00100000:3.0:1787786396.686291:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686777984 00000100:00100000:3.0:1787786396.686349:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1787786396.686360:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3311:x1874629686777984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786396.686424:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3311:x1874629686777984:12345-0@lo:400:kworker.0 Request processed in 66us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786396.686440:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787786396.686699:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5232899a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686777984:0@lo:400:kworker.0 00000100:00100000:0.0:1787786396.686980:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787786396.686993:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52328992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686778624:0@lo:400:kworker.0 00000100:00100000:0.0:1787786396.687028:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786396.687118:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686778624 00000100:00100000:1.0:1787786396.687124:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686778624 00000100:00100000:1.0:1787786396.687186:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787786396.687195:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523333bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686778624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786396.687238:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523333bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686778624:12345-0@lo:400:kworker.0 Request processed in 45us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786396.687244:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1787786396.687366:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787786396.687391:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b52328992c0 x1874629686778624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786396.687404:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52328992c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686778624:0@lo:400:kworker.0 00000100:00100000:3.0:1787786396.687530:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5232899a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874629686778496:0@lo:400:kworker.0 00000100:00100000:3.0:1787786396.687559:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786396.687663:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686778496 00000100:00100000:1.0:1787786396.687667:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686778496 00000100:00080000:0.0:1787786396.687828:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787786396.687909:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787786396.687917:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874629686778496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786396.688034:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874629686778496:12345-0@lo:400:kworker.0 Request processed in 117us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786396.688041:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787786396.689074:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5232899a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874629686778496:0@lo:400:kworker.0 00010000:00010000:1.0:1787786397.130054:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786397.197644:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787786397.197672:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bff8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686778752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787786397.197760:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786397.197971:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686778752 00000100:00100000:2.0:1787786397.197980:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686778752 00000100:00100000:2.0:1787786397.198051:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787786397.198061:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523289ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686778752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787786397.198097:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787786397.198160:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523289ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686778752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786397.198167:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1787786397.198386:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bff8b40 x1874629686778752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786397.198418:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bff8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686778752:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787786398.155998:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786398.645173:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786398.645216:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786398.645251:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786398.645287:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786398.645375:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667871104 00000100:00100000:0.0:1787786398.645385:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667871104 00000100:00100000:0.0:1787786398.645457:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667871360 00000100:00100000:0.0:1787786398.645460:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667871360 00000100:00100000:0.0:1787786398.645486:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 97 00000100:00100000:0.0:1787786398.645500:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523289b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+5:2362:x1874629667871104:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1787786398.645578:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523289b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+5:2362:x1874629667871104:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 84us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786398.645587:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 97 00000100:00100000:0.0:1787786398.645604:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 98 00000100:00100000:0.0:1787786398.645611:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523289bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e407027-7940-45d9-87d7-56031cd08b7a+5:2362:x1874629667871360:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1787786398.645634:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523289bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e407027-7940-45d9-87d7-56031cd08b7a+5:2362:x1874629667871360:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 25us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786398.645640:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 98 00000100:00080000:1.0:1787786398.645814:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787786398.645913:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667871232 00000100:00100000:3.0:1787786398.645918:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667871232 00000100:00100000:3.0:1787786398.645969:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 57 00000100:00100000:3.0:1787786398.646100:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523289b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+5:2362:x1874629667871232:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1787786398.646146:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523289b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+5:2362:x1874629667871232:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 56us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786398.646154:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 57 00000100:00100000:2.0:1787786398.649333:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667870976 00000100:00100000:2.0:1787786398.649348:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667870976 00000100:00100000:2.0:1787786398.649417:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 271 00000100:00100000:2.0:1787786398.649428:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2362:x1874629667870976:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786398.649506:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2362:x1874629667870976:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 80us (4345us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786398.649514:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 271 00000100:00080000:1.0:1787786398.649819:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787786399.186434:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786400.202621:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786400.778286:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686778880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787786400.778363:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786400.778509:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686778880 00000100:00100000:1.0:1787786400.778518:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686778880 00000100:00080000:0.0:1787786400.778587:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787786400.778589:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787786400.778611:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bffa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686778880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787786400.778656:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787786400.786986:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bffa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686778880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8369us (8611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786400.787002:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787786400.787115:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686778880:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787786401.226322:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786401.802413:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686779008:0@lo:400:kworker.0 00000100:00100000:0.0:1787786401.802506:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786401.802763:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686779008 00000100:00100000:1.0:1787786401.802779:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686779008 00000100:00100000:1.0:1787786401.802912:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1787786401.802926:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3312:x1874629686779008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786401.805386:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874629686779264:0@lo:400:kworker.0 00000100:00100000:3.0:1787786401.805464:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786401.805510:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1787786401.805517:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686779136:0@lo:400:kworker.0 00000100:00100000:3.0:1787786401.805538:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786401.805557:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686779648:0@lo:400:kworker.0 00000100:00100000:3.0:1787786401.805579:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786401.805610:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686779264 00000100:00100000:3.0:1787786401.805633:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686779264 00000100:00100000:2.0:1787786401.805934:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686779392:0@lo:400:kworker.0 00000100:00100000:2.0:1787786401.805978:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786401.806001:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787786401.806008:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874629686779520:0@lo:400:kworker.0 00000100:00100000:2.0:1787786401.806031:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786401.810878:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686779648 00000100:00100000:2.0:1787786401.810911:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686779648 00000100:00100000:2.0:1787786401.810970:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686779392 00000100:00100000:2.0:1787786401.810973:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686779392 00000100:00100000:2.0:1787786401.811000:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787786401.811010:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686779648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786401.811090:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686779648:12345-0@lo:400:kworker.0 Request processed in 81us (5509us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786401.811097:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787786401.811117:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787786401.811162:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686779392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786401.811209:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686779392:12345-0@lo:400:kworker.0 Request processed in 49us (5230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786401.811215:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787786401.812310:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3312:x1874629686779008:12345-0@lo:400:kworker.0 Request processed in 9374us (9792us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786401.812328:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00010000:00080000:1.0:1787786401.812517:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523b4d52c0 x1874629686779648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786401.812535:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686779648:0@lo:400:kworker.0 00000100:00080000:1.0:1787786401.812632:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787786401.812640:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787786401.812833:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686779136 00000100:00100000:3.0:1787786401.812848:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686779136 00000100:00100000:3.0:1787786401.812914:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686779520 00000100:00100000:3.0:1787786401.812917:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686779520 00000100:00100000:3.0:1787786401.812950:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787786401.812960:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874629686779264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786401.813043:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874629686779264:12345-0@lo:400:kworker.0 Request processed in 85us (7580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786401.813050:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1787786401.813064:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787786401.813070:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686779136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786401.813099:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686779136:12345-0@lo:400:kworker.0 Request processed in 29us (7559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786401.813105:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1787786401.813116:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1787786401.813122:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bffa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874629686779520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786401.813150:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bffa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874629686779520:12345-0@lo:400:kworker.0 Request processed in 29us (7119us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786401.813156:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1787786401.815079:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787786401.815142:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686779136:0@lo:400:kworker.0 00000100:00100000:3.0:1787786401.815157:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874629686779264:0@lo:400:kworker.0 00000100:00100000:3.0:1787786401.815227:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874629686779520:0@lo:400:kworker.0 00000100:00100000:3.0:1787786401.815238:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686779392:0@lo:400:kworker.0 00000100:00100000:0.0:1787786401.815612:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686779008:0@lo:400:kworker.0 00010000:00010000:1.0:1787786402.250462:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786402.314068:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787786402.314092:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bff9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686779776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787786402.314182:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786402.314478:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686779776 00000100:00100000:0.0:1787786402.314487:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686779776 00000100:00100000:0.0:1787786402.314537:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787786402.314547:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686779776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787786402.314582:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787786402.314812:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328983c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686779776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 265us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786402.314820:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1787786402.315084:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523bff9680 x1874629686779776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786402.315106:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bff9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686779776:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787786403.274059:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786403.769845:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786403.769884:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786403.769919:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786403.769946:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786403.769988:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667871616 00000100:00100000:0.0:1787786403.769997:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667871616 00000100:00100000:0.0:1787786403.770054:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667871872 00000100:00100000:0.0:1787786403.770058:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667871872 00000100:00100000:0.0:1787786403.770082:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 102 00000100:00100000:0.0:1787786403.770092:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523333a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+5:2363:x1874629667871616:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1787786403.770170:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523333a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+5:2363:x1874629667871616:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 79us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786403.770178:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 102 00000100:00100000:0.0:1787786403.770196:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 103 00000100:00100000:0.0:1787786403.770203:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b436d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e407027-7940-45d9-87d7-56031cd08b7a+5:2363:x1874629667871872:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1787786403.770227:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b436d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e407027-7940-45d9-87d7-56031cd08b7a+5:2363:x1874629667871872:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 24us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786403.770233:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 103 00000100:00100000:0.0:1787786403.770254:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667871488 00000100:00100000:0.0:1787786403.770257:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667871488 00000100:00100000:0.0:1787786403.770280:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 273 00000100:00100000:0.0:1787786403.770287:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52091c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2363:x1874629667871488:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1787786403.770311:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52091c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2363:x1874629667871488:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 24us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786403.770317:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 273 00000100:00080000:0.0:1787786403.770342:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787786403.770962:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667871744 00000100:00100000:2.0:1787786403.770968:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667871744 00000100:00100000:2.0:1787786403.771022:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 60 00000100:00100000:2.0:1787786403.771029:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103b78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:173d08e0-0e54-474e-858e-1679cd38cf14+5:2363:x1874629667871744:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786403.771070:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103b78b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:173d08e0-0e54-474e-858e-1679cd38cf14+5:2363:x1874629667871744:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 41us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786403.771076:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 60 00000100:00080000:0.0:1787786403.771235:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787786404.302221:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786405.322581:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786405.898412:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686779904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787786405.898490:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786405.898697:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686779904 00000100:00100000:3.0:1787786405.898706:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686779904 00000100:00100000:3.0:1787786405.898842:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787786405.898853:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686779904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787786405.898902:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787786405.898956:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686779904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786405.898963:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787786405.899010:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686779904:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787786405.899295:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787786406.346143:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787786406.603990:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1787786406.922422:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bffb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686780160:0@lo:400:kworker.0 00000100:00100000:3.0:1787786406.922495:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bff8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874629686780288:0@lo:400:kworker.0 00000100:00100000:2.0:1787786406.922504:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786406.922564:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686780160 00000100:00100000:0.0:1787786406.922571:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bffb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686780032:0@lo:400:kworker.0 00000100:00100000:1.0:1787786406.922573:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686780160 00000100:00100000:1.0:1787786406.922650:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787786406.922660:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b522349f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686780160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786406.927923:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786406.928140:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686780288 00000100:00100000:3.0:1787786406.928383:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686780288 00000100:00100000:3.0:1787786406.928456:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787786406.928482:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874629686780288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786406.928576:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874629686780288:12345-0@lo:400:kworker.0 Request processed in 98us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786406.928597:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1787786406.928632:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bff9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686780416:0@lo:400:kworker.0 00000100:00100000:3.0:1787786406.928671:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786406.928702:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686780416 00000100:00100000:3.0:1787786406.928707:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686780416 00000100:00100000:3.0:1787786406.928736:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787786406.928742:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686780416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786406.928777:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686780416:12345-0@lo:400:kworker.0 Request processed in 35us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786406.928818:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787786406.929443:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b522349c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686780672:0@lo:400:kworker.0 00000100:00100000:2.0:1787786406.929479:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786406.929527:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686780672 00000100:00100000:2.0:1787786406.929532:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686780672 00000100:00100000:3.0:1787786406.929543:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bff8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874629686780288:0@lo:400:kworker.0 00000100:00100000:2.0:1787786406.929569:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787786406.929578:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b522349c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686780672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786406.929594:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bff9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686780416:0@lo:400:kworker.0 00000100:00100000:2.0:1787786406.929638:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b522349c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686780672:12345-0@lo:400:kworker.0 Request processed in 60us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786406.929646:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1787786406.929657:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b522349c000 x1874629686780672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786406.929668:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b522349c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686780672:0@lo:400:kworker.0 00000100:00080000:3.0:1787786406.929698:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787786406.929704:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787786406.930649:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786406.930687:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bff92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874629686780544:0@lo:400:kworker.0 00000100:00100000:0.0:1787786406.930716:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786406.932089:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686780032 00000100:00100000:2.0:1787786406.932100:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686780032 00000100:00100000:2.0:1787786406.932158:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787786406.932169:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3312:x1874629686780032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786406.932241:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3312:x1874629686780032:12345-0@lo:400:kworker.0 Request processed in 75us (1594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786406.932249:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1787786406.932345:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b522349f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686780160:12345-0@lo:400:kworker.0 Request processed in 9684us (9838us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786406.932355:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787786406.932373:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686780544 00000100:00100000:1.0:1787786406.932376:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686780544 00000100:00100000:1.0:1787786406.932409:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787786406.932416:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103b79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874629686780544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786406.932448:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103b79e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874629686780544:12345-0@lo:400:kworker.0 Request processed in 33us (1731us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786406.932454:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787786406.932996:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bffb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686780160:0@lo:400:kworker.0 00000100:00080000:3.0:1787786406.933409:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787786406.934019:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bffb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686780032:0@lo:400:kworker.0 00000100:00100000:0.0:1787786406.934037:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bff92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874629686780544:0@lo:400:kworker.0 00010000:00010000:1.0:1787786407.370253:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786407.434636:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b522349de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686780800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787786407.434711:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786407.434864:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686780800 00000100:00100000:1.0:1787786407.434874:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686780800 00000100:00100000:1.0:1787786407.434919:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787786407.434929:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686780800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787786407.434965:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787786407.435029:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686780800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786407.435036:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1787786407.435166:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b522349de00 x1874629686780800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786407.435188:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b522349de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686780800:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787786408.395043:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786408.889876:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786408.889944:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786408.890045:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667872000 00000100:00100000:2.0:1787786408.890059:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667872000 00000100:00100000:2.0:1787786408.890125:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 275 00000100:00100000:2.0:1787786408.890136:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2362:x1874629667872000:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786408.890249:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2362:x1874629667872000:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 106us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786408.890258:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667872128 00000100:00100000:2.0:1787786408.890259:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 275 00000100:00100000:3.0:1787786408.890263:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667872128 00000100:00100000:3.0:1787786408.890320:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 107 00000100:00100000:3.0:1787786408.890328:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+5:2362:x1874629667872128:12345-192.168.204.34@tcp:400:kworker.0 00000100:00080000:2.0:1787786408.890349:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787786408.890362:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+5:2362:x1874629667872128:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 37us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786408.890370:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 107 00000100:00100000:2.0:1787786408.899904:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786408.900009:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667872256 00000100:00100000:3.0:1787786408.900022:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667872256 00000100:00100000:3.0:1787786408.900129:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 19 00000100:00100000:3.0:1787786408.900163:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b522349d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+5:2361:x1874629667872256:12345-192.168.204.34@tcp:9:kworker.0 00000020:00000080:3.0:1787786408.900207:0:6699:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff2283 00000100:00080000:2.0:1787786408.900407:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787786408.900560:0:6699:0:(import.c:65:import_set_state_nolock()) ffff8b5237c47800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787786408.900629:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:1.0:1787786408.901170:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786408.902437:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b522349d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+2:2361:x1874629667872256:12345-192.168.204.34@tcp:9:kworker.0 Request processed in 2265us (2536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786408.902452:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 19 00000100:00100000:0.0:1787786408.906307:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786408.918867:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667872384 00000100:00100000:1.0:1787786408.919310:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667872384 00000100:00100000:1.0:1787786408.919457:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 108 00000100:00100000:1.0:1787786408.919487:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e407027-7940-45d9-87d7-56031cd08b7a+5:2363:x1874629667872384:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1787786408.919644:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e407027-7940-45d9-87d7-56031cd08b7a+5:2363:x1874629667872384:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 166us (13672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786408.919653:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 108 00000100:00080000:2.0:1787786408.920346:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787786409.418069:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786410.442148:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786411.018168:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686780928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787786411.018270:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786411.018431:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686780928 00000100:00100000:3.0:1787786411.018442:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686780928 00000100:00100000:3.0:1787786411.018542:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787786411.018553:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686780928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787786411.018601:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787786411.018670:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686780928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786411.018677:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1787786411.019022:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787786411.019070:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686780928:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787786411.466131:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786412.044321:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b522349f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686781184:0@lo:400:kworker.0 00000100:00100000:2.0:1787786412.044423:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786412.044507:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b522349e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686781696:0@lo:400:kworker.0 00000100:00100000:2.0:1787786412.044536:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786412.044569:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787786412.044574:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b522349c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686781312:0@lo:400:kworker.0 00000100:00100000:3.0:1787786412.044831:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b522349cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686781440:0@lo:400:kworker.0 00000100:00100000:3.0:1787786412.044865:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786412.044887:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787786412.044893:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b522349ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686781056:0@lo:400:kworker.0 00000100:00100000:3.0:1787786412.044922:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786412.044945:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b522349cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874629686781568:0@lo:400:kworker.0 00000100:00100000:3.0:1787786412.044967:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786412.044968:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686781696 00000100:00100000:1.0:1787786412.044979:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686781696 00000100:00100000:3.0:1787786412.045000:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686781184 00000100:00100000:3.0:1787786412.045003:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686781184 00000100:00100000:3.0:1787786412.045044:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686781568 00000100:00100000:1.0:1787786412.045044:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686781440 00000100:00100000:3.0:1787786412.045047:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686781568 00000100:00100000:1.0:1787786412.045047:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686781440 00000100:00100000:1.0:1787786412.045069:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787786412.045079:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b522349e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686781696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786412.045086:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787786412.045091:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b522349d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686781184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786412.045130:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b522349d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686781184:12345-0@lo:400:kworker.0 Request processed in 38us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786412.045130:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b522349e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686781696:12345-0@lo:400:kworker.0 Request processed in 52us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786412.045138:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787786412.045143:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787786412.045155:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787786412.045155:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787786412.045162:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874629686781568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786412.045162:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686781440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786412.045235:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786412.045277:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b522349f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686781184:0@lo:400:kworker.0 00010000:00080000:2.0:1787786412.045291:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b522349e580 x1874629686781696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786412.045302:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b522349e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686781696:0@lo:400:kworker.0 00000100:00100000:2.0:1787786412.045346:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686781312 00000100:00100000:2.0:1787786412.045350:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686781312 00000100:00100000:2.0:1787786412.045371:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787786412.045377:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b522349f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686781312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786412.045413:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b522349f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686781312:12345-0@lo:400:kworker.0 Request processed in 36us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786412.045420:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787786412.045446:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686781056 00000100:00100000:2.0:1787786412.045449:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686781056 00000100:00100000:2.0:1787786412.045473:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1787786412.045479:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3311:x1874629686781056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786412.045543:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874629686781568:12345-0@lo:400:kworker.0 Request processed in 30us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786412.045550:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:0.0:1787786412.045774:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787786412.045780:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787786412.045881:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b522349c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686781312:0@lo:400:kworker.0 00000100:00100000:1.0:1787786412.047598:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686781440:12345-0@lo:400:kworker.0 Request processed in 2424us (2719us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786412.047614:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787786412.055159:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3311:x1874629686781056:12345-0@lo:400:kworker.0 Request processed in 9661us (10218us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786412.055179:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1787786412.060060:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b522349ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686781056:0@lo:400:kworker.0 00000100:00100000:3.0:1787786412.060095:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b522349cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874629686781568:0@lo:400:kworker.0 00000100:00100000:3.0:1787786412.060111:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b522349cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686781440:0@lo:400:kworker.0 00010000:00010000:1.0:1787786412.490097:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786412.554485:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787786412.554510:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b522349e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686781824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787786412.554588:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786412.563736:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686781824 00000100:00100000:1.0:1787786412.563751:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686781824 00000100:00100000:1.0:1787786412.563844:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787786412.563863:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686781824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787786412.563911:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787786412.564249:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686781824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 387us (9659us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786412.564258:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1787786412.564549:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b522349e580 x1874629686781824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786412.564571:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b522349e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686781824:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787786413.514941:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787786413.679409:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 173d08e0-0e54-474e-858e-1679cd38cf14 00000020:00000080:3.0:1787786413.679419:0:6723:0:(genops.c:885:class_export_put()) final put ffff8b5237c43800/173d08e0-0e54-474e-858e-1679cd38cf14 00000020:00000080:2.0:1787786413.679718:0:481:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5237c43800/173d08e0-0e54-474e-858e-1679cd38cf14 for lustre-OST0000 00000020:00000080:2.0:1787786413.680064:0:481:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5237c47800 for lustre-OST0000 00000100:00100000:3.0:1787786414.002733:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786414.002778:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786414.002825:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786414.002985:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667872512 00000100:00100000:2.0:1787786414.002996:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667872512 00000100:00100000:2.0:1787786414.003055:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 277 00000100:00100000:2.0:1787786414.003065:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2363:x1874629667872512:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786414.003145:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2363:x1874629667872512:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 81us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786414.003153:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 277 00000100:00100000:2.0:1787786414.003191:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667872768 00000100:00100000:2.0:1787786414.003195:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667872768 00000100:00100000:2.0:1787786414.003228:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667872640 00000100:00100000:2.0:1787786414.003231:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667872640 00000100:00100000:2.0:1787786414.003248:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 112 00000100:00100000:2.0:1787786414.003255:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e407027-7940-45d9-87d7-56031cd08b7a+5:2363:x1874629667872768:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786414.003283:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e407027-7940-45d9-87d7-56031cd08b7a+5:2363:x1874629667872768:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 29us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786414.003290:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 112 00000100:00100000:2.0:1787786414.003300:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 113 00000100:00100000:2.0:1787786414.003306:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+5:2363:x1874629667872640:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786414.003325:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+5:2363:x1874629667872640:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 19us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786414.003343:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 113 00000100:00080000:2.0:1787786414.003361:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787786414.538087:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786415.562097:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786416.138669:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bffb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686781952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787786416.138760:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786416.139134:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686781952 00000100:00100000:2.0:1787786416.139144:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686781952 00000100:00100000:2.0:1787786416.139243:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787786416.139264:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686781952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787786416.139315:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787786416.139365:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686781952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786416.139372:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1787786416.139397:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787786416.140004:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bffb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686781952:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787786416.587157:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787786416.595598:0:11859:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 19:20:15 (1787786415) 00000040:00080000:0.0:1787786416.842659:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787786417.162481:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787786417.162626:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b522349da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686782208:0@lo:400:kworker.0 00000100:00100000:3.0:1787786417.162725:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786417.162849:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787786417.162857:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b522349f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686782336:0@lo:400:kworker.0 00000100:00100000:3.0:1787786417.162884:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786417.162946:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686782208 00000100:00100000:3.0:1787786417.162975:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686782208 00000100:00100000:3.0:1787786417.163034:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686782336 00000100:00100000:3.0:1787786417.163038:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686782336 00000100:00100000:3.0:1787786417.163077:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787786417.163088:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bffb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686782208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786417.163151:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bffb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686782208:12345-0@lo:400:kworker.0 Request processed in 65us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786417.163160:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1787786417.163181:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1787786417.163188:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686782336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786417.163219:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686782336:12345-0@lo:400:kworker.0 Request processed in 32us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786417.163225:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:3.0:1787786417.163253:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787786417.163294:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b522349f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686782336:0@lo:400:kworker.0 00000100:00100000:3.0:1787786417.163307:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b522349da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686782208:0@lo:400:kworker.0 00000100:00100000:0.0:1787786417.165698:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787786417.165738:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b522349e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686782464:0@lo:400:kworker.0 00000100:00100000:0.0:1787786417.165892:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786417.167246:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686782464 00000100:00100000:3.0:1787786417.167264:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686782464 00000100:00100000:3.0:1787786417.167357:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787786417.167371:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686782464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786417.167496:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b330c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686782464:12345-0@lo:400:kworker.0 Request processed in 128us (1604us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786417.167504:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787786417.167841:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b522349e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686782464:0@lo:400:kworker.0 00000100:00100000:1.0:1787786417.168031:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b522349e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686782080:0@lo:400:kworker.0 00000100:00100000:1.0:1787786417.168089:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786417.168315:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686782080 00000100:00100000:0.0:1787786417.168322:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686782080 00000100:00100000:0.0:1787786417.168377:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1787786417.168398:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3311:x1874629686782080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786417.168447:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3311:x1874629686782080:12345-0@lo:400:kworker.0 Request processed in 62us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786417.168454:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1787786417.168532:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b522349e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686782080:0@lo:400:kworker.0 00000100:00100000:0.0:1787786417.168948:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b522349cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874629686782592:0@lo:400:kworker.0 00000100:00100000:0.0:1787786417.168989:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786417.169088:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686782592 00000100:00100000:3.0:1787786417.169095:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686782592 00000100:00100000:3.0:1787786417.169154:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787786417.169161:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b32d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874629686782592:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787786417.169248:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787786417.169364:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b522349cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686782720:0@lo:400:kworker.0 00000100:00100000:2.0:1787786417.169416:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786417.169517:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686782720 00000100:00100000:1.0:1787786417.169522:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686782720 00000100:00100000:1.0:1787786417.169580:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787786417.169596:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b522349ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686782720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786417.169639:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b522349ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686782720:12345-0@lo:400:kworker.0 Request processed in 45us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786417.169646:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1787786417.169693:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b522349cf00 x1874629686782720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787786433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786417.169707:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b522349cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686782720:0@lo:400:kworker.0 00000100:00080000:2.0:1787786417.169900:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787786417.170666:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b32d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874629686782592:12345-0@lo:400:kworker.0 Request processed in 1499us (1670us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786417.170678:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1787786417.170838:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b522349cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874629686782592:0@lo:400:kworker.0 00010000:00010000:0.0:1787786417.611500:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786417.675067:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b522349c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686782848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787786417.675206:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786417.675600:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686782848 00000100:00100000:2.0:1787786417.675612:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686782848 00000100:00100000:2.0:1787786417.675687:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787786417.675699:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686782848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787786417.675824:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787786417.675962:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686782848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 239us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786417.675982:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1787786417.676523:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b522349c780 x1874629686782848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786417.676551:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b522349c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686782848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787786417.996282:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786417.996363:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667872896 00000100:00100000:3.0:1787786417.996385:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667872896 00000100:00100000:3.0:1787786417.996479:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 32 00000100:00100000:3.0:1787786417.996489:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221a9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+5:10251:x1874629667872896:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787786417.996517:0:8713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786417.996540:0:8713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff234e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752205 expref: -99 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786417.996614:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7800/0x450132973bff2355 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786417.996630:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7800/0x450132973bff2355 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786417.996643:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7800/0x450132973bff2355 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786417.997159:0:8713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787786417.997164:0:8713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787786417.997250:0:8713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7800/0x450132973bff2355 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786417.997276:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff234e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752205 expref: 7 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786417.997304:0:8713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7800/0x450132973bff2355 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752205 expref: 6 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786417.997313:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5204e6fe00) 00010000:00010000:3.0:1787786417.997316:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787786417.997319:0:8713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb7800, rc 0) 00000100:00100000:3.0:1787786417.997396:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221a9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+6:10251:x1874629667872896:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 908us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786417.997404:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 32 00000100:00080000:2.0:1787786417.998174:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787786418.007950:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786418.008116:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667873024 00000100:00100000:3.0:1787786418.008149:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667873024 00000100:00100000:3.0:1787786418.008283:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 33 00000100:00100000:3.0:1787786418.008296:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+6:10252:x1874629667873024:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787786418.008336:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786418.008363:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff235c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75220c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786418.008462:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2363 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786418.008479:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2363 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786418.008491:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2363 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786418.008507:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff236a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786418.008532:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff236a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786418.008540:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff236a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786418.012742:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7000/0x450132973bff2371 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786418.012779:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7000/0x450132973bff2371 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786418.012819:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7000/0x450132973bff2371 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786418.013086:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787786418.013091:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787786418.013196:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7000/0x450132973bff2371 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786418.013211:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2363 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786418.013219:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2363 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786418.013227:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2363 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786418.013233:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7600 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786418.013238:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2363 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786418.013256:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2363 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786418.013491:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5204e6fe00) 00010000:00010000:3.0:1787786418.013496:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786418.013504:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2363 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786418.013511:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2363 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786418.013528:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff236a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786418.013534:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff236a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786418.013539:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff236a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786418.013544:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb6200 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786418.013547:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff236a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786418.013553:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff236a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786418.013562:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8b5204e6f600) 00010000:00010000:3.0:1787786418.013565:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786418.013568:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff236a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786418.013583:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff236a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786418.013640:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff235c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75220c expref: 8 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786418.013656:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7000/0x450132973bff2371 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75220c expref: 7 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786418.013664:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8b5204e6f500) 00010000:00010000:3.0:1787786418.013666:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787786418.013669:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb7000, rc 0) 00000100:00100000:3.0:1787786418.013775:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+7:10252:x1874629667873024:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 5480us (5837us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786418.013786:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 33 00000100:00100000:1.0:1787786418.022106:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786418.022219:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667873280 00000100:00100000:3.0:1787786418.022232:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667873280 00000100:00100000:3.0:1787786418.022316:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 34 00000100:00100000:3.0:1787786418.022329:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5232899e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+7:10252:x1874629667873280:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787786418.022357:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786418.022396:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff2378 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752213 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786418.022496:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff237f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786418.022514:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff237f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786418.022547:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff237f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786418.025901:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2386 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786418.026464:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2386 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786418.026552:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2386 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786418.028417:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac800/0x450132973bff238d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786418.028446:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac800/0x450132973bff238d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786418.028469:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac800/0x450132973bff238d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786418.029692:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787786418.030228:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff237f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786418.030242:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff237f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786418.030250:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff237f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786418.030257:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb6200 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786418.030262:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff237f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786418.030270:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff237f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786418.030288:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8b5204e6f500) 00010000:00010000:2.0:1787786418.030291:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786418.030296:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff237f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786418.030302:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff237f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786418.030320:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2386 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786418.030326:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2386 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786418.030341:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2386 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786418.030346:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7600 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786418.030350:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2386 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786418.030356:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2386 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786418.030365:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8b5204e6f600) 00010000:00010000:2.0:1787786418.030382:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786418.030386:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2386 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786418.030392:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2386 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786418.033232:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff2378 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752213 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786418.033266:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac800/0x450132973bff238d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752213 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786418.033275:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b5210c81800) 00010000:00010000:2.0:1787786418.033278:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786418.033283:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aac800, rc 0) 00000100:00100000:2.0:1787786418.033396:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5232899e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+9:10252:x1874629667873280:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 11069us (11305us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787786418.033418:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 34 00000100:00100000:0.0:1787786418.041954:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786418.043136:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667873408 00000100:00100000:3.0:1787786418.043153:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667873408 00000100:00100000:3.0:1787786418.043285:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 35 00000100:00100000:3.0:1787786418.043297:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221a9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+9:10252:x1874629667873408:12345-192.168.204.34@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787786418.043463:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221a9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+9:10252:x1874629667873408:12345-192.168.204.34@tcp:59:lhsmtool_posix.0 Request processed in 168us (1525us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786418.043472:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 35 00000001:00080000:3.0:1787786418.268247:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:1.0:1787786418.634076:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787786418.890553:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787786419.130445:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786419.130491:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786419.130577:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786419.130639:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667873536 00000100:00100000:2.0:1787786419.130649:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667873536 00000100:00100000:2.0:1787786419.130707:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 279 00000100:00100000:2.0:1787786419.130720:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2365:x1874629667873536:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786419.130813:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2365:x1874629667873536:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 96us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786419.130821:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 279 00000100:00100000:1.0:1787786419.145108:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667873664 00000100:00100000:1.0:1787786419.145124:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667873664 00000100:00100000:2.0:1787786419.151026:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667873792 00000100:00100000:2.0:1787786419.151042:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667873792 00000100:00100000:2.0:1787786419.151131:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 117 00000100:00100000:2.0:1787786419.151142:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221a9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e407027-7940-45d9-87d7-56031cd08b7a+5:2364:x1874629667873792:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786419.151229:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221a9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e407027-7940-45d9-87d7-56031cd08b7a+5:2364:x1874629667873792:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 89us (20651us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786419.151238:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 117 00000100:00100000:2.0:1787786419.151409:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 118 00000100:00100000:2.0:1787786419.151417:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221a9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+8:2365:x1874629667873664:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786419.151460:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221a9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+8:2365:x1874629667873664:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 44us (20969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786419.151467:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 118 00000100:00080000:1.0:1787786419.154104:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787786419.658994:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786419.858664:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786419.858827:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667873920 00000100:00100000:3.0:1787786419.858836:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667873920 00000100:00100000:3.0:1787786419.858898:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 36 00000100:00100000:3.0:1787786419.858908:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+8:10294:x1874629667873920:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:3.0:1787786419.858926:0:7644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786419.858945:0:7644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff239b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75221a expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.859018:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff23a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.859031:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff23a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.859041:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff23a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.859055:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff23a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.859071:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff23a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.859077:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff23a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.859316:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff23a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.859324:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff23a2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.859330:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff23a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.859350:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb6800 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786419.859354:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff23a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.859372:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff23a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.859386:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5204e6fe00) 00010000:00010000:3.0:1787786419.859389:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786419.859393:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff23a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.859399:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff23a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.859411:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff23a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.859417:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff23a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.859422:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff23a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.859427:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb6200 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786419.859430:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff23a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.859435:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff23a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.859443:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8b5204e6fb00) 00010000:00010000:3.0:1787786419.859445:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786419.859448:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff23a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.859463:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff23a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.859495:0:7644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff239b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75221a expref: 9 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.859505:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5204e6fe00) 00010000:00010000:3.0:1787786419.859507:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786419.859511:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff239b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75221a expref: 9 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.859520:0:7644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb7600, rc 0) 00000100:00100000:3.0:1787786419.859580:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+8:10294:x1874629667873920:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 674us (929us total) trans 0 rc 301/301 00000100:00100000:3.0:1787786419.859588:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 36 00000100:00100000:2.0:1787786419.864672:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786419.864926:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667874176 00000100:00100000:3.0:1787786419.864936:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667874176 00000100:00100000:3.0:1787786419.864993:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 37 00000100:00100000:3.0:1787786419.865118:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b522349de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+8:10294:x1874629667874176:12345-192.168.204.34@tcp:36:lfs.0 00010000:00010000:3.0:1787786419.865199:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786419.865230:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7800/0x450132973bff2355 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752205 expref: 8 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.865252:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5204e6fe00) 00010000:00010000:3.0:1787786419.865263:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787786419.865697:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff23b0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.865721:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff23b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.865731:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff23b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.865744:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff23b7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.865752:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff23b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.865758:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff23b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786419.867973:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787786419.867990:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff23b0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.868107:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff23b0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.868118:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff23b0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.868125:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb6a00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786419.868131:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff23b0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.868139:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff23b0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.868170:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5204e6f000) 00010000:00010000:3.0:1787786419.868173:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786419.868179:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff23b0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.868185:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff23b0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787786419.868206:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000452160d5 reply state 00000000b49c66d5 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff23b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786419.868215:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787786419.868450:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b522349de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+9:10294:x1874629667874176:12345-192.168.204.34@tcp:36:lfs.0 Request processed in 3445us (3788us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787786419.868459:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 37 00010000:00010000:1.0:1787786419.870569:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff23b7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786419.870587:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff23b7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786419.870595:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff23b7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786419.870601:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7a00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786419.870606:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff23b7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786419.870613:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff23b7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786419.870630:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8b5204e6f100) 00010000:00010000:1.0:1787786419.870640:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787786419.870645:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff23b7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786419.870652:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff23b7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786419.973018:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786419.973075:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667874304 00000100:00100000:3.0:1787786419.973085:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667874304 00000100:00100000:3.0:1787786419.973158:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 38 00000100:00100000:3.0:1787786419.973169:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b522349c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+8:10302:x1874629667874304:12345-192.168.204.34@tcp:101:lctl.0 00010000:00010000:3.0:1787786419.973200:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786419.973226:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff23be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752221 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.973296:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7800/0x450132973bff23c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.973310:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7800/0x450132973bff23c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.973361:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7800/0x450132973bff23c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786419.973434:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787786419.973438:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787786419.973505:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7800/0x450132973bff23c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.973538:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff23be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752221 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.973558:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7800/0x450132973bff23c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752221 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786419.973566:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5204e6f000) 00010000:00010000:3.0:1787786419.973569:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787786419.973572:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb7800, rc 0) 00000100:00100000:3.0:1787786419.973724:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b522349c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+9:10302:x1874629667874304:12345-192.168.204.34@tcp:101:lctl.0 Request processed in 556us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786419.973731:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 38 00000100:00100000:3.0:1787786420.033890:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786420.034161:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667874432 00000100:00100000:1.0:1787786420.034171:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667874432 00000100:00100000:1.0:1787786420.034275:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 39 00000100:00100000:1.0:1787786420.034285:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bffb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+9:10308:x1874629667874432:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:1.0:1787786420.034306:0:8713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786420.034328:0:8713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201677c00/0x450132973bff23cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752228 expref: -99 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.034416:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676600/0x450132973bff23d3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.034430:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676600/0x450132973bff23d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.034441:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676600/0x450132973bff23d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.034454:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201677400/0x450132973bff23da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.034461:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201677400/0x450132973bff23da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.034467:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201677400/0x450132973bff23da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.034585:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676000/0x450132973bff23e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.034595:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676000/0x450132973bff23e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.034602:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676000/0x450132973bff23e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787786420.034633:0:8713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1787786420.034636:0:8713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787786420.034677:0:8713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676000/0x450132973bff23e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.034690:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676600/0x450132973bff23d3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.034696:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676600/0x450132973bff23d3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.034704:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676600/0x450132973bff23d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.034722:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5201676600 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786420.034726:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676600/0x450132973bff23d3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.034734:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676600/0x450132973bff23d3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.034745:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5204e6f000) 00010000:00010000:1.0:1787786420.034763:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787786420.034768:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676600/0x450132973bff23d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.034774:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676600/0x450132973bff23d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.034827:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201677400/0x450132973bff23da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.034832:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201677400/0x450132973bff23da lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.034838:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201677400/0x450132973bff23da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.034843:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5201677400 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786420.034846:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201677400/0x450132973bff23da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.034852:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201677400/0x450132973bff23da lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.034860:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8b52100f1700) 00010000:00010000:1.0:1787786420.034862:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787786420.034865:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201677400/0x450132973bff23da lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.034871:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201677400/0x450132973bff23da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.034902:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201677c00/0x450132973bff23cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752228 expref: 11 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.034928:0:8713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676000/0x450132973bff23e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752228 expref: 10 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.034936:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b52100f1600) 00010000:00010000:1.0:1787786420.034939:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787786420.034941:0:8713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5201676000, rc 0) 00000100:00100000:1.0:1787786420.035013:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bffb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+10:10308:x1874629667874432:12345-192.168.204.34@tcp:101:bash.0 Request processed in 730us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786420.035021:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 39 00000100:00100000:1.0:1787786420.039318:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786420.039578:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667874688 00000100:00100000:3.0:1787786420.039589:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667874688 00000100:00100000:3.0:1787786420.039650:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 40 00000100:00100000:3.0:1787786420.039660:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523289a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+10:10308:x1874629667874688:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:3.0:1787786420.039682:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786420.039702:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff23e8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75222f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.040117:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff23ef lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.040132:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff23ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.040143:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff23ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.040157:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff23f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.040163:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff23f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.040170:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff23f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787786420.041174:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1787786420.041690:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff23fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.041704:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff23fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.041713:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff23fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.041747:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff23ef lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.041765:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff23ef lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.041771:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff23ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.041777:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7600 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786420.041781:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff23ef lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.042032:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff23ef lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.042048:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b52100f1600) 00010000:00010000:3.0:1787786420.042052:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786420.042056:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff23ef lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.042062:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff23ef lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787786420.042076:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009ae5f802 reply state 000000005939ead5 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff23f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786420.042084:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787786420.042118:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff23e8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75222f expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.042131:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff23fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75222f expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.042149:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b5204e6fb00) 00010000:00010000:3.0:1787786420.042152:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787786420.042154:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb6800, rc 0) 00000100:00100000:3.0:1787786420.043642:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523289a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+13:10308:x1874629667874688:12345-192.168.204.34@tcp:101:bash.0 Request processed in 3974us (4323us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787786420.043654:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 40 00010000:00010000:2.0:1787786420.048291:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff23f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.048327:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff23f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.048351:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff23f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.048358:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb6200 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786420.048363:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff23f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.048372:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff23f6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.048389:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b5204e6fe00) 00010000:00010000:2.0:1787786420.048393:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786420.048398:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff23f6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.048404:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff23f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786420.050706:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786420.050827:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667874816 00000100:00100000:3.0:1787786420.050837:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667874816 00000100:00100000:3.0:1787786420.051095:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 20 00000100:00100000:3.0:1787786420.051104:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523289a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2361:x1874629667874816:12345-192.168.204.34@tcp:8:bash.0 00010000:00080000:3.0:1787786420.051136:0:6700:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 173d08e0-0e54-474e-858e-1679cd38cf14@192.168.204.34@tcp t0 exp 0000000000000000 cur 346 last 0 00000020:00000080:3.0:1787786420.051167:0:6700:0:(genops.c:1385:class_connect()) connect: client 173d08e0-0e54-474e-858e-1679cd38cf14, cookie 0x450132973bff240b 00002000:00100000:3.0:1787786420.051179:0:6700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 173d08e0-0e54-474e-858e-1679cd38cf14/ffff8b523c0b0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113935 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787786420.051203:0:6700:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787786420.051454:0:6700:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787786420.052265:0:6700:0:(import.c:65:import_set_state_nolock()) ffff8b523c0b5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787786420.052356:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523289a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:173d08e0-0e54-474e-858e-1679cd38cf14+6:2361:x1874629667874816:12345-192.168.204.34@tcp:8:bash.0 Request processed in 1250us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786420.052367:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 20 00000100:00100000:0.0:1787786420.055300:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786420.055391:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667874944 00000100:00100000:1.0:1787786420.055400:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667874944 00000100:00100000:1.0:1787786420.055661:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 21 00000100:00100000:1.0:1787786420.055672:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+6:0:x1874629667874944:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:1.0:1787786420.055689:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786420.055710:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000020db7619/0x450132973bff2412 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752236 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787786420.055737:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787786420.055756:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=346s v=(0 0) 00010000:00010000:1.0:1787786420.055761:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786420.055773:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000020db7619/0x450132973bff2412 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752236 expref: 7 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.055855:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000020db7619/0x450132973bff2412 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752236 expref: 7 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.055870:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5201677c00, rc 0) 00000100:00100000:1.0:1787786420.055933:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+7:0:x1874629667874944:12345-192.168.204.34@tcp:101:bash.0 Request processed in 264us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786420.055940:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 21 00000100:00080000:2.0:1787786420.056745:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787786420.062713:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786420.062904:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667875072 00000100:00100000:0.0:1787786420.062916:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667875072 00000100:00100000:0.0:1787786420.063022:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 22 00000100:00100000:0.0:1787786420.063034:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b522349c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+7:10308:x1874629667875072:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:0.0:1787786420.063063:0:8126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786420.063084:0:8126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f43d737c/0x450132973bff2419 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75223d expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.063116:0:8126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000020db7619/0x450132973bff2412 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752236 expref: 8 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.063126:0:8126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787786420.063130:0:8126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787786420.063136:0:8126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f43d737c/0x450132973bff2419 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75223d expref: 8 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.063171:0:8126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000020db7619/0x450132973bff2412 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752236 expref: 8 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.063211:0:8126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000020db7619/0x450132973bff2412 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752236 expref: 8 pid: 6699 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786420.063226:0:8126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360e1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8126:1874629686782976:192.168.204.34@tcp:104: 00000100:00100000:0.0:1787786420.063351:0:8126:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5206dcde40 going to sleep for 11 seconds 00000100:00100000:0.0:1787786420.069231:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786420.069356:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667875200 00000100:00100000:2.0:1787786420.069366:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667875200 00010000:00010000:2.0:1787786420.069409:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000020db7619/0x450132973bff2412 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752236 expref: 9 pid: 6699 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786420.069453:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 35 00000100:00100000:2.0:1787786420.069464:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:173d08e0-0e54-474e-858e-1679cd38cf14+9:2364:x1874629667875200:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787786420.069491:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787786420.069527:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000020db7619/0x450132973bff2412 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752236 expref: 9 pid: 6699 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.069542:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000020db7619/0x450132973bff2412 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752236 expref: 9 pid: 6699 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.069572:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787786420.069577:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787786420.069586:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f43d737c/0x450132973bff2419 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75223d expref: 9 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.069597:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f43d737c/0x450132973bff2419 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75223d expref: 9 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.069632:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f43d737c/0x450132973bff2419 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75223d expref: 9 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786420.069646:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b522349cb40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5831:1874629686783104:192.168.204.34@tcp:105: 00000100:00100000:2.0:1787786420.069728:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52328bd180 going to sleep for 11 seconds 00010000:00010000:1.0:1787786420.071223:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020db7619/0x450132973bff2412 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752236 expref: 9 pid: 6699 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786420.071246:0:8126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360e1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8126:1874629686782976:192.168.204.34@tcp:104: 00010000:00010000:1.0:1787786420.071276:0:8126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f43d737c/0x450132973bff2419 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75223d expref: 8 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.071288:0:8126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912ce00, rc 0) 00000100:00100000:1.0:1787786420.071359:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b522349c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+8:10308:x1874629667875072:12345-192.168.204.34@tcp:101:bash.0 Request processed in 8327us (8656us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786420.071367:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 22 00000100:00100000:2.0:1787786420.074198:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b522349cb40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5831:1874629686783104:192.168.204.34@tcp:105: 00010000:00010000:2.0:1787786420.074225:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787786420.074280:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:173d08e0-0e54-474e-858e-1679cd38cf14+7:2364:x1874629667875200:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 4817us (5060us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786420.074290:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 35 00000100:00100000:2.0:1787786420.075770:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786420.076845:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667875456 00000100:00100000:0.0:1787786420.076858:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667875456 00000100:00100000:0.0:1787786420.076976:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 6 00000100:00100000:0.0:1787786420.076987:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b522349cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+12:10308:x1874629667875456:12345-192.168.204.34@tcp:35:bash.0 00000100:00100000:0.0:1787786420.077346:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b522349cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+13:10308:x1874629667875456:12345-192.168.204.34@tcp:35:bash.0 Request processed in 360us (1583us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787786420.077354:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 6 00000100:00100000:2.0:1787786420.149148:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786420.149274:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667875712 00000100:00100000:3.0:1787786420.149284:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667875712 00000100:00100000:3.0:1787786420.149368:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 41 00000100:00100000:3.0:1787786420.149378:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b522349cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+13:10318:x1874629667875712:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:3.0:1787786420.149402:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786420.150401:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff2420 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752244 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786420.150552:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787786420.150900:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff2420 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752244 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.150917:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5204e6f000) 00010000:00010000:3.0:1787786420.150920:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787786420.150925:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff2420 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752244 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.150940:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb6a00, rc 0) 00000100:00100000:3.0:1787786420.151011:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b522349cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+14:10318:x1874629667875712:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 1634us (1871us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1787786420.151020:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 41 00000100:00100000:1.0:1787786420.154875:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786420.154953:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667875968 00000100:00100000:3.0:1787786420.154964:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667875968 00000100:00100000:3.0:1787786420.155023:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:3.0:1787786420.155034:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5232898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+14:10318:x1874629667875968:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:3.0:1787786420.155651:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5232898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+15:10318:x1874629667875968:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 615us (782us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787786420.155661:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:2.0:1787786420.231585:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786420.232194:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667876096 00000100:00100000:1.0:1787786420.232204:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667876096 00000100:00100000:1.0:1787786420.232265:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 42 00000100:00100000:1.0:1787786420.232273:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b522349e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+15:10324:x1874629667876096:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:1.0:1787786420.232315:0:8713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786420.232348:0:8713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201677c00/0x450132973bff242e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75224b expref: -99 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.232430:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676600/0x450132973bff2435 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.232446:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676600/0x450132973bff2435 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.232457:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676600/0x450132973bff2435 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787786420.232528:0:8713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1787786420.232533:0:8713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787786420.232565:0:8713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676600/0x450132973bff2435 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.232598:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201677c00/0x450132973bff242e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75224b expref: 17 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.232626:0:8713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676600/0x450132973bff2435 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75224b expref: 16 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.232635:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b52100f1600) 00010000:00010000:1.0:1787786420.232638:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787786420.232642:0:8713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5201676600, rc 0) 00000100:00100000:1.0:1787786420.232713:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b522349e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+16:10324:x1874629667876096:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 441us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786420.232721:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 42 00000100:00100000:2.0:1787786420.241458:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786420.241552:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667876352 00000100:00100000:3.0:1787786420.241564:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667876352 00000100:00100000:3.0:1787786420.241625:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 43 00000100:00100000:3.0:1787786420.241635:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b522349e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+16:10324:x1874629667876352:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:3.0:1787786420.241673:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786420.241707:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff243c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752252 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.242089:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2443 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.242106:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.242117:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786420.242128:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787786420.242311:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff243c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752252 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.242345:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2443 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752252 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.242354:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b5204e6fb00) 00010000:00010000:3.0:1787786420.242357:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787786420.242361:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb7600, rc 0) 00000100:00100000:3.0:1787786420.242546:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b522349e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+18:10324:x1874629667876352:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 911us (1097us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1787786420.242555:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 43 00000100:00100000:0.0:1787786420.247112:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786420.247164:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786420.247168:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667876480 00000100:00100000:3.0:1787786420.247178:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667876480 00000100:00100000:3.0:1787786420.247314:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 2 00000100:00100000:3.0:1787786420.247355:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+18:2365:x1874629667876480:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787786420.247372:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786420.247396:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2443 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752252 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.247418:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b5204e6fb00) 00010000:00010000:3.0:1787786420.247423:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787786420.247455:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667876736 00000100:00100000:2.0:1787786420.247462:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667876736 00000100:00100000:3.0:1787786420.247495:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+18:2365:x1874629667876480:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 142us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786420.247503:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 44 00000100:00100000:3.0:1787786420.247508:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 2 00000100:00100000:2.0:1787786420.247515:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+18:10324:x1874629667876736:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:2.0:1787786420.248491:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786420.248513:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff2451 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752259 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.248969:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2458 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.248985:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2458 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.248996:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2458 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786420.249007:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787786420.249126:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff2451 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752259 expref: 20 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.249142:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2458 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752259 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.249150:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b5204e6fb00) 00010000:00010000:2.0:1787786420.249164:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787786420.249169:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aac000, rc 0) 00000100:00100000:2.0:1787786420.249225:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+19:10324:x1874629667876736:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 1713us (2062us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787786420.249234:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 44 00000100:00100000:1.0:1787786420.261750:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786420.261877:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667876864 00000100:00100000:3.0:1787786420.261889:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667876864 00000100:00100000:3.0:1787786420.261951:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 23 00000100:00100000:3.0:1787786420.261961:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5232899a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+7:2363:x1874629667876864:12345-192.168.204.34@tcp:1:lfs.0 00010000:00010000:3.0:1787786420.262025:0:6699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008358bafe/0x450132973bff2466 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.262044:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f43d737c/0x450132973bff2419 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75223d expref: 7 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.262054:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787786420.262058:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787786420.262063:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008358bafe/0x450132973bff2466 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.262097:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f43d737c/0x450132973bff2419 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75223d expref: 7 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.262128:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f43d737c/0x450132973bff2419 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75223d expref: 7 pid: 8126 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786420.262143:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bff92c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6699:1874629686783232:192.168.204.34@tcp:104: 00000100:00100000:3.0:1787786420.263036:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5208f50240 going to sleep for 11 seconds 00000100:00100000:2.0:1787786420.267542:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786420.267689:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667876992 00000100:00100000:3.0:1787786420.267698:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667876992 00000100:00100000:1.0:1787786420.267764:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bff92c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6699:1874629686783232:192.168.204.34@tcp:104: 00002000:00100000:3.0:1787786420.267819:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8b522349da40 x1874629667876992/t0(0) o4->173d08e0-0e54-474e-858e-1679cd38cf14@192.168.204.34@tcp:36/0 lens 504/0 e 0 to 0 dl 1787786431 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787786420.267831:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8b522349da40 with x1874629667876992 ext(0->12) 00010000:00010000:3.0:1787786420.267840:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f43d737c/0x450132973bff2419 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75223d expref: 8 pid: 8126 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.267856:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f43d737c/0x450132973bff2419 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75223d expref: 8 pid: 8126 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787786420.267864:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8b522349da40 00000100:00100000:3.0:1787786420.267896:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 0 00000100:00100000:3.0:1787786420.267907:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b522349da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:173d08e0-0e54-474e-858e-1679cd38cf14+8:2364:x1874629667876992:12345-192.168.204.34@tcp:4:lfs.0 00010000:00010000:1.0:1787786420.269035:0:6699:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008358bafe/0x450132973bff2466 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1787786420.318997:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 173d08e0-0e54-474e-858e-1679cd38cf14 00000100:00100000:1.0:1787786420.319619:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b522349da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:173d08e0-0e54-474e-858e-1679cd38cf14+9:2364:x1874629667876992:12345-192.168.204.34@tcp:4:lfs.0 Request processed in 51707us (52091us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787786420.319636:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 0 00002000:00100000:1.0:1787786420.319650:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8b522349da40 x1874629667876992/t4294967299(0) o4->173d08e0-0e54-474e-858e-1679cd38cf14@192.168.204.34@tcp:36/0 lens 504/448 e 0 to 0 dl 1787786431 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787786420.319660:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8b522349da40 with x1874629667876992 ext(0->12) 00010000:00010000:1.0:1787786420.319669:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f43d737c/0x450132973bff2419 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75223d expref: 9 pid: 8126 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.319686:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f43d737c/0x450132973bff2419 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75223d expref: 9 pid: 8126 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787786420.319694:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8b522349da40 00000100:00100000:1.0:1787786420.324245:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786420.324366:0:8508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667877120 00000100:00100000:0.0:1787786420.324376:0:8508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667877120 00010000:00010000:0.0:1787786420.324418:0:8508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f43d737c/0x450132973bff2419 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75223d expref: 9 pid: 8126 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786420.324461:0:8508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 36 00000100:00100000:0.0:1787786420.324471:0:8508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328992c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:173d08e0-0e54-474e-858e-1679cd38cf14+9:2362:x1874629667877120:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787786420.324487:0:8508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787786420.324507:0:8508:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787786420.324523:0:8508:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787786420 00002000:00010000:0.0:1787786420.324525:0:8508:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787786420 00002000:00010000:0.0:1787786420.324527:0:8508:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787786420 00010000:00010000:0.0:1787786420.324535:0:8508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f43d737c/0x450132973bff2419 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75223d expref: 9 pid: 8126 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.324548:0:8508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f43d737c/0x450132973bff2419 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75223d expref: 9 pid: 8126 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.324571:0:8508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f43d737c/0x450132973bff2419 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75223d expref: 9 pid: 8126 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.324588:0:8508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787786420.324592:0:8508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787786420.324597:0:8508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008358bafe/0x450132973bff2466 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.324607:0:8508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008358bafe/0x450132973bff2466 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.324641:0:8508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787786420.324702:0:8508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328992c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:173d08e0-0e54-474e-858e-1679cd38cf14+8:2362:x1874629667877120:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 232us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786420.324709:0:8508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 36 00010000:00010000:3.0:1787786420.324945:0:6699:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008358bafe/0x450132973bff2466 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.324956:0:6699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008358bafe/0x450132973bff2466 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.324999:0:6699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008358bafe/0x450132973bff2466 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.325008:0:6699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008358bafe/0x450132973bff2466 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.325016:0:6699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008358bafe/0x450132973bff2466 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.325024:0:6699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7600 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:3.0:1787786420.325028:0:6699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008358bafe/0x450132973bff2466 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.325038:0:6699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008358bafe/0x450132973bff2466 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.325054:0:6699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008358bafe/0x450132973bff2466 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.325062:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008358bafe/0x450132973bff2466 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786420.325120:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5232899a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+7:2363:x1874629667876864:12345-192.168.204.34@tcp:1:lfs.0 Request processed in 63160us (63379us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786420.325129:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 23 00000100:00100000:2.0:1787786420.332666:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786420.333152:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667877376 00000100:00100000:0.0:1787786420.333164:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667877376 00000100:00100000:0.0:1787786420.333278:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00100000:0.0:1787786420.333289:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b522349f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+19:10324:x1874629667877376:12345-192.168.204.34@tcp:35:lfs.0 00000004:00010000:0.0:1787786420.333382:0:5850:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2458 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752259 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787786420.333706:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1787786420.333766:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1787786420.334658:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1787786420.334725:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff246d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.334743:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff23fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75222f expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.334753:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff246d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.334787:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff23fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75222f expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.335081:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff23fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75222f expref: 23 pid: 5846 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786420.335099:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5850:1874629686783360:192.168.204.34@tcp:104: 00000100:00100000:0.0:1787786420.335271:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5206dcd180 going to sleep for 11 seconds 00000100:00100000:1.0:1787786420.339277:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5850:1874629686783360:192.168.204.34@tcp:104: 00010000:00010000:1.0:1787786420.339310:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff246d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786420.339684:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786420.339779:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667877504 00000100:00100000:0.0:1787786420.339786:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667877504 00010000:00010000:0.0:1787786420.339850:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff23fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75222f expref: 24 pid: 5846 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786420.339887:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 37 00000100:00100000:0.0:1787786420.339905:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a35a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:173d08e0-0e54-474e-858e-1679cd38cf14+24:2364:x1874629667877504:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787786420.339920:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787786420.339928:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff23fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75222f expref: 24 pid: 5846 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.339942:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff23fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75222f expref: 24 pid: 5846 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.339975:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff23fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75222f expref: 24 pid: 5846 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.339991:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b5204e6fb00) 00010000:00010000:0.0:1787786420.339997:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff246d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.340006:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff246d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.340012:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff246d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.340147:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787786420.340218:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a35a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:173d08e0-0e54-474e-858e-1679cd38cf14+23:2364:x1874629667877504:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 314us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786420.340227:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 37 00010000:00010000:2.0:1787786420.340629:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff246d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.340639:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff246d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787786420.340765:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1787786420.341155:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1787786420.341308:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237a34000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1874629686783488:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787786420.341379:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786420.341848:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686783488 00000100:00100000:0.0:1787786420.341857:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686783488 00000100:00100000:0.0:1787786420.341926:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787786420.341936:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1874629686783488:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1787786420.342356:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787786420.342668:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52328bd240 going to sleep for 11 seconds 00000100:00100000:0.0:1787786420.342852:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1874629686783488:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 915us (1471us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786420.342860:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787786420.342953:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237a34000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1874629686783488:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787786420.343647:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1787786420.343718:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237a34000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1874629686783616:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787786420.343759:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786420.343871:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52328bd180 going to sleep for 11 seconds 00000100:00100000:0.0:1787786420.344513:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686783616 00000100:00100000:0.0:1787786420.344521:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686783616 00000100:00100000:0.0:1787786420.344606:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787786420.344615:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1874629686783616:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787786420.344927:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a343c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5850:x1874629686783616:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 313us (1166us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787786420.344936:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787786420.344995:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237a34000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1874629686783616:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787786420.345166:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:1.0:1787786420.345223:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff246d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.345234:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff246d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.345241:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff246d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.345248:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912ce00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786420.345252:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff246d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.345259:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff246d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.345275:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b5204e6fb00) 00010000:00010000:1.0:1787786420.345278:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787786420.345282:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff246d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.345288:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff246d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787786420.345490:0:5850:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787786420.345705:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1787786420.345717:0:5850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 346703926174ns, next at 347703923777ns, rc = 0 00000001:00080000:1.0:1787786420.345724:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:1.0:1787786420.345759:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b5204e6fb00) 00010000:00010000:1.0:1787786420.345762:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787786420.345769:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2458 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752259 expref: 27 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786420.346143:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b522349f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+26:10324:x1874629667877376:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 12855us (13489us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1787786420.346157:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 8 00000020:00080000:1.0:1787786420.346163:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787786420.349363:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786420.349502:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667877632 00000100:00100000:1.0:1787786420.349512:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667877632 00000100:00100000:1.0:1787786420.349603:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 45 00000100:00100000:1.0:1787786420.349613:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+26:10324:x1874629667877632:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:1.0:1787786420.349637:0:8713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786420.349660:0:8713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201677400/0x450132973bff2474 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752260 expref: -99 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.349728:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201677400/0x450132973bff2474 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752260 expref: 27 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.349742:0:8713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201677400/0x450132973bff2474 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752260 expref: 27 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786420.349760:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b52100f1200) 00010000:00010000:1.0:1787786420.349763:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787786420.349767:0:8713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5201677400, rc 0) 00000100:00100000:1.0:1787786420.349862:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+27:10324:x1874629667877632:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 250us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786420.349870:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 45 00000100:00100000:3.0:1787786420.352641:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786420.352737:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667877888 00000100:00100000:0.0:1787786420.352749:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667877888 00000100:00100000:0.0:1787786420.352844:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 9 00000100:00100000:0.0:1787786420.352854:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52062ff850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+27:10324:x1874629667877888:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:0.0:1787786420.353085:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52062ff850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+28:10324:x1874629667877888:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 232us (452us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1787786420.353093:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 9 00000100:00100000:3.0:1787786420.442448:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786420.442560:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667878144 00000100:00100000:2.0:1787786420.442570:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667878144 00000100:00100000:2.0:1787786420.442644:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 46 00000100:00100000:2.0:1787786420.442671:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+28:10334:x1874629667878144:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:2.0:1787786420.442697:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786420.442721:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff247b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752267 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786420.442892:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787786420.443033:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff247b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752267 expref: 30 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.443048:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5204e6f000) 00010000:00010000:2.0:1787786420.443051:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787786420.443056:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff247b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752267 expref: 30 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.443072:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aadc00, rc 0) 00000100:00100000:3.0:1787786420.443487:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+29:10334:x1874629667878144:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 815us (1045us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1787786420.443496:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 46 00000100:00100000:2.0:1787786420.448433:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786420.448588:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667878272 00000100:00100000:0.0:1787786420.448597:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667878272 00000100:00100000:0.0:1787786420.448662:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 47 00000100:00100000:0.0:1787786420.448673:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a35e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+29:10334:x1874629667878272:12345-192.168.204.34@tcp:34:lfs.0 00010000:00010000:0.0:1787786420.448753:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2489 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.448770:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2489 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.448827:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2489 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.448844:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2490 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.448851:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2490 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.448858:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2490 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.449061:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff2497 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.449071:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff2497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.449077:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff2497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787786420.449119:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff2497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.449134:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2489 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.449140:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2489 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.449147:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2489 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.449164:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912dc00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786420.449169:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2489 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.449176:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2489 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.449189:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b52100f1600) 00010000:00010000:0.0:1787786420.449192:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786420.449196:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2489 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.449202:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2489 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.449215:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2490 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.449221:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2490 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.449227:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2490 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.449231:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912ce00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786420.449234:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2490 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.449240:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2490 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.449258:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b5222ae8d00) 00010000:00010000:0.0:1787786420.449261:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786420.449264:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2490 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.449271:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2490 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.449291:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff2497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.449297:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff2497 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.449303:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff2497 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.449308:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912d400 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786420.449310:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff2497 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.449316:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff2497 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.449335:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b52100f1200) 00010000:00010000:0.0:1787786420.449337:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786420.449340:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff2497 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.449345:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff2497 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786420.449438:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a35e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+29:10334:x1874629667878272:12345-192.168.204.34@tcp:34:lfs.0 Request processed in 767us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786420.449447:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 47 00000100:00100000:2.0:1787786420.452217:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786420.452291:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667878528 00000100:00100000:0.0:1787786420.452301:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667878528 00000100:00100000:0.0:1787786420.452368:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00100000:0.0:1787786420.452380:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+29:10334:x1874629667878528:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:0.0:1787786420.452657:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+30:10334:x1874629667878528:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 278us (448us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1787786420.452665:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00100000:1.0:1787786420.501945:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786420.502096:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667878784 00000100:00100000:2.0:1787786420.502106:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667878784 00000100:00100000:2.0:1787786420.502173:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 48 00000100:00100000:2.0:1787786420.502184:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5232898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+30:10337:x1874629667878784:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:2.0:1787786420.502207:0:8713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786420.502237:0:8713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff249e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75226e expref: -99 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.502311:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff24a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.502357:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff24a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.502368:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff24a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.502384:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff24ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.502390:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff24ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.502397:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff24ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.502544:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aace00/0x450132973bff24b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.502553:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aace00/0x450132973bff24b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.502561:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aace00/0x450132973bff24b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786420.502571:0:8713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787786420.502898:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff24a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.502907:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff24a5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.502913:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff24a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.502928:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aade00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786420.502932:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff24a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.502939:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff24a5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.502950:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b52100f1600) 00010000:00010000:2.0:1787786420.502953:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786420.502957:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff24a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.502963:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff24a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.502978:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff24ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.502984:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff24ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.502989:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff24ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.502994:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aac200 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786420.502997:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff24ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.503003:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff24ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.503023:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b5210c81400) 00010000:00010000:2.0:1787786420.503025:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786420.503028:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff24ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.503034:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff24ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.503079:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff249e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75226e expref: 33 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.503093:0:8713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aace00/0x450132973bff24b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75226e expref: 32 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.503100:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b52100f1200) 00010000:00010000:2.0:1787786420.503103:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787786420.503105:0:8713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aace00, rc 0) 00000100:00100000:2.0:1787786420.503170:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5232898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+32:10337:x1874629667878784:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 988us (1236us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1787786420.503179:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 48 00000100:00100000:2.0:1787786420.509976:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786420.510102:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667878912 00000100:00100000:0.0:1787786420.510110:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667878912 00000100:00100000:0.0:1787786420.510197:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 49 00000100:00100000:0.0:1787786420.510205:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a36d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+32:10337:x1874629667878912:12345-192.168.204.34@tcp:54:lfs.0 00010000:00010000:0.0:1787786420.510269:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff24c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.510286:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff24c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.510298:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff24c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.510339:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff24c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.510345:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff24c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.510365:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff24c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.510371:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912ce00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786420.510376:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff24c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.510383:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff24c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.510394:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b52100f1200) 00010000:00010000:0.0:1787786420.510397:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787786420.510401:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff24c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.510407:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff24c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786420.510484:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a36d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+32:10337:x1874629667878912:12345-192.168.204.34@tcp:54:lfs.0 Request processed in 279us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786420.510491:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 49 00000100:00100000:1.0:1787786420.517917:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786420.518877:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667879168 00000100:00100000:0.0:1787786420.518891:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667879168 00000100:00100000:0.0:1787786420.518965:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 11 00000100:00100000:0.0:1787786420.518976:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523298bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+32:10337:x1874629667879168:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:0.0:1787786420.519296:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523298bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+33:10337:x1874629667879168:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 321us (1391us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1787786420.519383:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 11 00010000:00010000:0.0:1787786420.682711:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786420.811245:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786420.811384:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667879424 00000100:00100000:2.0:1787786420.811402:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667879424 00000100:00100000:2.0:1787786420.812122:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 50 00000100:00100000:2.0:1787786420.812135:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5232988b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+33:10369:x1874629667879424:12345-192.168.204.34@tcp:101:cat.0 00010000:00010000:2.0:1787786420.812162:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786420.812183:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff24c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752275 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.812330:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff24cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.812344:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff24cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.812355:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff24cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786420.812366:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787786420.813098:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff24c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752275 expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.813121:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff24cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752275 expref: 35 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786420.813129:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b52100f1200) 00010000:00010000:2.0:1787786420.813132:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787786420.813135:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aade00, rc 0) 00000100:00100000:2.0:1787786420.813223:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5232988b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+35:10369:x1874629667879424:12345-192.168.204.34@tcp:101:cat.0 Request processed in 1090us (1992us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1787786420.813231:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 50 00000100:00100000:2.0:1787786420.821416:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786420.821976:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786420.822060:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667879552 00000100:00100000:0.0:1787786420.822070:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667879552 00000100:00100000:0.0:1787786420.822142:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 3 00000100:00100000:0.0:1787786420.822152:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5211bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+35:2365:x1874629667879552:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787786420.822169:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787786420.822206:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff24cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752275 expref: 35 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.822226:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b52100f1200) 00010000:00010000:0.0:1787786420.822231:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787786420.822293:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5211bf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+34:2365:x1874629667879552:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 143us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786420.822301:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 3 00000100:00100000:3.0:1787786420.823309:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667879808 00000100:00100000:3.0:1787786420.823329:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667879808 00000100:00100000:3.0:1787786420.823419:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00100000:3.0:1787786420.823444:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+34:10369:x1874629667879808:12345-192.168.204.34@tcp:35:cat.0 00000100:00100000:3.0:1787786420.823735:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+35:10369:x1874629667879808:12345-192.168.204.34@tcp:35:cat.0 Request processed in 298us (2328us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1787786420.823745:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00100000:2.0:1787786420.913475:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786420.913832:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667880064 00000100:00100000:3.0:1787786420.913842:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667880064 00000100:00100000:3.0:1787786420.914116:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 51 00000100:00100000:3.0:1787786420.914130:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a34780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+35:10375:x1874629667880064:12345-192.168.204.34@tcp:101:dd.0 00010000:00010000:3.0:1787786420.914157:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786420.914160:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787786420.914194:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676600/0x450132973bff2435 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75224b expref: 35 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.914215:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b52100f1600) 00010000:00010000:3.0:1787786420.914220:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787786420.914235:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff24dd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75227c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.914365:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff24e4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.914380:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aace00/0x450132973bff24b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75226e expref: 35 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.914388:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff24e4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.914422:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aace00/0x450132973bff24b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75226e expref: 35 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.914435:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aace00/0x450132973bff24b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75226e expref: 35 pid: 8713 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786420.914448:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bffa1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874629686783744:192.168.204.34@tcp:104: 00000100:00100000:3.0:1787786420.914555:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b4bec00 going to sleep for 11 seconds 00000100:00100000:1.0:1787786420.919927:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786420.920159:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bffa1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874629686783744:192.168.204.34@tcp:104: 00010000:00010000:3.0:1787786420.920198:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff24e4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786420.920915:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667880192 00000100:00100000:0.0:1787786420.920923:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667880192 00010000:00010000:0.0:1787786420.920964:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aace00/0x450132973bff24b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75226e expref: 36 pid: 8713 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786420.921013:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 38 00000100:00100000:0.0:1787786420.921024:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523298a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:173d08e0-0e54-474e-858e-1679cd38cf14+36:2365:x1874629667880192:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787786420.921039:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787786420.921045:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aace00/0x450132973bff24b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75226e expref: 36 pid: 8713 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.921057:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aace00/0x450132973bff24b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75226e expref: 36 pid: 8713 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.921100:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aace00/0x450132973bff24b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75226e expref: 36 pid: 8713 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.921116:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b52100f1200) 00010000:00010000:0.0:1787786420.921121:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff24e4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.921130:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff24e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.921138:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff24e4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.921168:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787786420.921249:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523298a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:173d08e0-0e54-474e-858e-1679cd38cf14+35:2365:x1874629667880192:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 227us (1332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786420.921257:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 38 00010000:00010000:3.0:1787786420.922017:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff24e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.922028:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff24e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786420.922050:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787786420.922253:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff24dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75227c expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.922271:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff24e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75227c expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786420.922280:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b52100f1200) 00010000:00010000:3.0:1787786420.922283:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787786420.922286:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb6a00, rc 0) 00000100:00100000:3.0:1787786420.922544:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a34780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+35:10375:x1874629667880064:12345-192.168.204.34@tcp:101:dd.0 Request processed in 8417us (9079us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1787786420.922554:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 51 00000100:00100000:1.0:1787786420.932157:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786420.932274:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667880448 00000100:00100000:0.0:1787786420.932286:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667880448 00000100:00100000:0.0:1787786420.932374:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 52 00000100:00100000:0.0:1787786420.932385:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523298a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+35:10375:x1874629667880448:12345-192.168.204.34@tcp:36:dd.0 00010000:00010000:0.0:1787786420.932933:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff24f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.932952:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff24f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.932963:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff24f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787786420.933030:0:7644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1787786420.933055:0:7644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f6bf4074 reply state 00000000959e8f0a transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff24f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786420.933064:0:7644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787786420.934678:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523298a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+38:10375:x1874629667880448:12345-192.168.204.34@tcp:36:dd.0 Request processed in 2285us (2521us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1787786420.934690:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 52 00000020:00080000:0.0:1787786420.934697:0:7644:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787786420.944494:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff24f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.944513:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff24f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.944520:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff24f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.944526:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912ce00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786420.944532:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff24f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.944539:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff24f2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.944558:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b52100f1200) 00010000:00010000:0.0:1787786420.944561:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786420.944565:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff24f2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786420.944571:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff24f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786421.244261:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786421.244450:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667880576 00000100:00100000:2.0:1787786421.244460:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667880576 00000100:00100000:2.0:1787786421.244542:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 53 00000100:00100000:2.0:1787786421.244563:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bfde940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+37:10389:x1874629667880576:12345-192.168.204.34@tcp:101:stat.0 00010000:00010000:2.0:1787786421.244588:0:8713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786421.244608:0:8713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff24f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752283 expref: -99 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.244679:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2500 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.244693:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2500 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787786421.244865:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787786421.245021:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2500 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.245038:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2507 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.245046:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2507 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.245053:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2507 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.245159:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff250e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.245171:0:8713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff24e4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75227c expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.245179:0:8713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff250e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.245226:0:8713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff24e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75227c expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.245241:0:8713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff24e4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75227c expref: 38 pid: 5846 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786421.245260:0:8713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237a34b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8713:1874629686783872:192.168.204.34@tcp:104: 00000100:00100000:2.0:1787786421.245426:0:8713:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52328bdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787786421.252150:0:8713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237a34b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8713:1874629686783872:192.168.204.34@tcp:104: 00010000:00010000:2.0:1787786421.252183:0:8713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff250e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786421.255551:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786421.255897:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667880832 00000100:00100000:0.0:1787786421.255907:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667880832 00000100:00100000:0.0:1787786421.255974:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 13 00000100:00100000:0.0:1787786421.255985:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bfdda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+39:5618:x1874629667880832:12345-192.168.204.34@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787786421.256359:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bfdda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+40:5618:x1874629667880832:12345-192.168.204.34@tcp:35:ldlm_bl.0 Request processed in 375us (816us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1787786421.256368:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 13 00000100:00100000:1.0:1787786421.258092:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bffa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686784000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787786421.258161:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786421.258303:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686784000 00000100:00100000:2.0:1787786421.258320:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686784000 00000100:00100000:2.0:1787786421.258386:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787786421.258399:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bfdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686784000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787786421.258433:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787786421.258484:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bfdc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686784000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786421.258490:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787786421.258612:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bffa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686784000:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787786421.258674:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787786421.267064:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786421.267152:0:11675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667880960 00000100:00100000:3.0:1787786421.267163:0:11675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667880960 00010000:00010000:3.0:1787786421.267206:0:11675:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff24e4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75227c expref: 40 pid: 5846 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786421.267256:0:11675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 39 00000100:00100000:3.0:1787786421.267266:0:11675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bfdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:173d08e0-0e54-474e-858e-1679cd38cf14+40:2365:x1874629667880960:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787786421.267281:0:11675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786421.267288:0:11675:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff24e4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75227c expref: 40 pid: 5846 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786421.267301:0:11675:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff24e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75227c expref: 40 pid: 5846 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786421.267357:0:11675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff24e4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75227c expref: 40 pid: 5846 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786421.267373:0:11675:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b52100f1200) 00010000:00010000:3.0:1787786421.267379:0:11675:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff250e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786421.267388:0:11675:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff250e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786421.267409:0:11675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff250e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786421.267449:0:11675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787786421.267509:0:11675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bfdf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:173d08e0-0e54-474e-858e-1679cd38cf14+39:2365:x1874629667880960:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 243us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786421.267516:0:11675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 39 00010000:00010000:2.0:1787786421.267658:0:8713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff250e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.267667:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff250e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786421.267727:0:8713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787786421.267738:0:8713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787786421.267786:0:8713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff250e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.267827:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff250e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.267838:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2500 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.267844:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2500 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.267850:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2500 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.267856:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aaca00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786421.267860:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2500 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.267867:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2500 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.267876:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b52100f1600) 00010000:00010000:2.0:1787786421.267879:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786421.267882:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2500 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.267888:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2500 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.267899:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2507 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.267916:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2507 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.267922:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2507 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.267926:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aad600 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786421.267929:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2507 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.267935:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2507 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.267942:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b5210c81400) 00010000:00010000:2.0:1787786421.267946:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786421.267948:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2507 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.267954:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2507 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.267989:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff24f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752283 expref: 39 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.268002:0:8713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff250e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752283 expref: 38 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.268009:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b52100f1200) 00010000:00010000:2.0:1787786421.268011:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787786421.268021:0:8713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aad800, rc 0) 00000100:00100000:2.0:1787786421.268065:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bfde940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+38:10389:x1874629667880576:12345-192.168.204.34@tcp:101:stat.0 Request processed in 23507us (23813us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786421.268072:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 53 00000100:00100000:2.0:1787786421.341156:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786421.341245:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667881216 00000100:00100000:3.0:1787786421.341255:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667881216 00000100:00100000:3.0:1787786421.341368:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 54 00000100:00100000:3.0:1787786421.341381:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a34b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+38:10395:x1874629667881216:12345-192.168.204.34@tcp:36:truncate.0 00010000:00010000:3.0:1787786421.341452:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786421.341479:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff250e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752283 expref: 38 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786421.341499:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b52100f1200) 00010000:00010000:3.0:1787786421.341504:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787786421.341753:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff2515 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786421.341768:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff2515 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786421.341778:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff2515 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787786421.342564:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1787786421.342596:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008492c9ad reply state 0000000057ec590b transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff2515 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786421.342607:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787786421.342745:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a34b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+40:10395:x1874629667881216:12345-192.168.204.34@tcp:36:truncate.0 Request processed in 1364us (1595us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1787786421.342753:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 54 00000020:00080000:3.0:1787786421.342757:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787786421.344714:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff2515 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786421.344731:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff2515 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786421.344739:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff2515 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786421.344745:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb6a00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786421.344750:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff2515 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786421.344758:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff2515 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786421.344773:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b52100f1200) 00010000:00010000:0.0:1787786421.344776:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786421.344780:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff2515 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786421.344786:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff2515 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786421.483582:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786421.484450:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667881344 00000100:00100000:0.0:1787786421.484461:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667881344 00000100:00100000:1.0:1787786421.484747:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 55 00000100:00100000:1.0:1787786421.484760:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a34f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+39:10409:x1874629667881344:12345-192.168.204.34@tcp:101:stat.0 00010000:00010000:1.0:1787786421.484812:0:7644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786421.484838:0:7644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201677c00/0x450132973bff251c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75228a expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.484928:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676600/0x450132973bff2523 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.484945:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676600/0x450132973bff2523 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.484969:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676600/0x450132973bff2523 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.484987:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520151b200/0x450132973bff252a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.484995:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520151b200/0x450132973bff252a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.485020:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520151b200/0x450132973bff252a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.485140:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2531 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.485150:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.485156:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787786421.485195:0:7644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1787786421.485199:0:7644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787786421.485221:0:7644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.485234:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2531 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.485242:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676600/0x450132973bff2523 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.485248:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676600/0x450132973bff2523 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.485254:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676600/0x450132973bff2523 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.485260:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5201676600 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786421.485264:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676600/0x450132973bff2523 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.485278:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676600/0x450132973bff2523 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.485291:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b52100f1600) 00010000:00010000:1.0:1787786421.485295:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787786421.485300:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676600/0x450132973bff2523 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.485317:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676600/0x450132973bff2523 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.485333:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520151b200/0x450132973bff252a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.485338:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520151b200/0x450132973bff252a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.485344:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520151b200/0x450132973bff252a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.485349:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520151b200 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786421.485352:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520151b200/0x450132973bff252a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.485358:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520151b200/0x450132973bff252a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.485365:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b52100f1400) 00010000:00010000:1.0:1787786421.485368:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787786421.485370:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520151b200/0x450132973bff252a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.485386:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520151b200/0x450132973bff252a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.485431:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201677c00/0x450132973bff251c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75228a expref: 41 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.485445:0:7644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2531 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75228a expref: 40 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.485451:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b52100f1200) 00010000:00010000:1.0:1787786421.485454:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787786421.485456:0:7644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523b4d8c00, rc 0) 00000100:00100000:1.0:1787786421.485532:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a34f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+40:10409:x1874629667881344:12345-192.168.204.34@tcp:101:stat.0 Request processed in 774us (1960us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786421.485550:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 55 00000100:00100000:1.0:1787786421.555916:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786421.556321:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667881600 00000100:00100000:2.0:1787786421.556331:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667881600 00000100:00100000:2.0:1787786421.556451:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 56 00000100:00100000:2.0:1787786421.556462:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bfdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+40:10419:x1874629667881600:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:2.0:1787786421.557238:0:8713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786421.557262:0:8713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2538 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752291 expref: -99 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786421.557403:0:8713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787786421.557676:0:8713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2538 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752291 expref: 42 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.557691:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5204e6f000) 00010000:00010000:2.0:1787786421.557694:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787786421.557699:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2538 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752291 expref: 42 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.557716:0:8713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aad200, rc 0) 00000100:00100000:2.0:1787786421.557843:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bfdc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+41:10419:x1874629667881600:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 1382us (1937us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1787786421.557851:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 56 00000100:00100000:3.0:1787786421.560824:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786421.560910:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667881856 00000100:00100000:0.0:1787786421.560920:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667881856 00000100:00100000:3.0:1787786421.561179:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 14 00000100:00100000:3.0:1787786421.561192:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bffbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+41:10419:x1874629667881856:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:3.0:1787786421.562652:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bffbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+42:10419:x1874629667881856:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 1456us (1866us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1787786421.562663:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 14 00000100:00100000:3.0:1787786421.605358:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786421.605666:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667882112 00000100:00100000:0.0:1787786421.605679:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667882112 00000100:00100000:0.0:1787786421.605850:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 57 00000100:00100000:0.0:1787786421.605862:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bffa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+42:10425:x1874629667882112:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:0.0:1787786421.605891:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786421.605914:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2546 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752298 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786421.606037:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff254d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786421.606053:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2531 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75228a expref: 43 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786421.606064:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff254d lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786421.606104:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2531 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75228a expref: 43 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786421.606120:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2531 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75228a expref: 43 pid: 7644 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786421.606134:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874629686784128:192.168.204.34@tcp:104: 00000100:00100000:0.0:1787786421.606825:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5206dcdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787786421.610895:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874629686784128:192.168.204.34@tcp:104: 00010000:00010000:0.0:1787786421.611200:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff254d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786421.611518:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786421.611617:0:8508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667882240 00000100:00100000:1.0:1787786421.611627:0:8508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667882240 00010000:00010000:1.0:1787786421.611677:0:8508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2531 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75228a expref: 44 pid: 7644 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786421.611719:0:8508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 40 00000100:00100000:1.0:1787786421.611728:0:8508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237b53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:173d08e0-0e54-474e-858e-1679cd38cf14+44:2364:x1874629667882240:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787786421.611745:0:8508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786421.611751:0:8508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2531 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75228a expref: 44 pid: 7644 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.611784:0:8508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2531 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75228a expref: 44 pid: 7644 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.611842:0:8508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2531 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75228a expref: 44 pid: 7644 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.611859:0:8508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b52100f1200) 00010000:00010000:1.0:1787786421.611863:0:8508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff254d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.611871:0:8508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff254d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.611879:0:8508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff254d lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.611912:0:8508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786421.611968:0:8508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237b53480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:173d08e0-0e54-474e-858e-1679cd38cf14+43:2364:x1874629667882240:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 241us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786421.612080:0:8508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 40 00010000:00010000:3.0:1787786421.612448:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff254d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786421.612462:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff254d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786421.612515:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1787786421.612741:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2546 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752298 expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786421.612765:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff254d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752298 expref: 43 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786421.612775:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b52100f1200) 00010000:00010000:3.0:1787786421.612778:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787786421.612782:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912dc00, rc 0) 00000100:00100000:3.0:1787786421.614777:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bffa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+43:10425:x1874629667882112:12345-192.168.204.34@tcp:101:bash.0 Request processed in 8900us (9417us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1787786421.614810:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 57 00000100:00100000:3.0:1787786421.624315:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786421.624461:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667882496 00000100:00100000:1.0:1787786421.624478:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667882496 00000100:00100000:1.0:1787786421.624567:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 58 00000100:00100000:1.0:1787786421.624579:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237b503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+43:10425:x1874629667882496:12345-192.168.204.34@tcp:36:bash.0 00010000:00010000:1.0:1787786421.625032:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff255b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.625057:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff255b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.625090:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff255b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787786421.625157:0:7644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1787786421.625186:0:7644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e71f811 reply state 00000000570fc538 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff255b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786421.625196:0:7644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787786421.625341:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237b503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+46:10425:x1874629667882496:12345-192.168.204.34@tcp:36:bash.0 Request processed in 761us (1053us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1787786421.625350:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 58 00000020:00080000:1.0:1787786421.625357:0:7644:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787786421.629888:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff255b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786421.629908:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff255b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786421.629928:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff255b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786421.629934:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8c00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786421.629940:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff255b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786421.629948:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff255b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786421.629967:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b52100f1200) 00010000:00010000:0.0:1787786421.629970:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786421.629975:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff255b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786421.629982:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff255b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786421.634001:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786421.634228:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667882624 00000100:00100000:2.0:1787786421.634259:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667882624 00000100:00100000:2.0:1787786421.634363:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 59 00000100:00100000:2.0:1787786421.634377:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237b51e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+45:10425:x1874629667882624:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:2.0:1787786421.634413:0:8713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786421.634445:0:8713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2562 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75229f expref: -99 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.634577:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2569 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.634595:0:8713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff254d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752298 expref: 46 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.634607:0:8713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2569 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.634654:0:8713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff254d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752298 expref: 46 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.634675:0:8713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff254d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752298 expref: 46 pid: 5846 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786421.634693:0:8713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237a36580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8713:1874629686784256:192.168.204.34@tcp:104: 00000100:00100000:2.0:1787786421.634859:0:8713:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52328bdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787786421.639409:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786421.639537:0:8713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237a36580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8713:1874629686784256:192.168.204.34@tcp:104: 00010000:00010000:2.0:1787786421.639568:0:8713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2569 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786421.639629:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667882752 00000100:00100000:0.0:1787786421.639636:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667882752 00010000:00010000:0.0:1787786421.639691:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff254d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752298 expref: 47 pid: 5846 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786421.639733:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 41 00000100:00100000:0.0:1787786421.639743:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bfdde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:173d08e0-0e54-474e-858e-1679cd38cf14+47:2365:x1874629667882752:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787786421.639759:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787786421.639766:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff254d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752298 expref: 47 pid: 5846 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786421.639778:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff254d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752298 expref: 47 pid: 5846 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786421.639842:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff254d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752298 expref: 47 pid: 5846 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786421.639863:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b52100f1200) 00010000:00010000:0.0:1787786421.639869:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2569 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786421.639877:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786421.639884:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2569 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786421.639909:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787786421.640093:0:8713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.640106:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786421.640152:0:8713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787786421.640157:0:8713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787786421.640184:0:8713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.640216:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2562 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75229f expref: 47 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.640232:0:8713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2569 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75229f expref: 46 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.640239:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b52100f1200) 00010000:00010000:2.0:1787786421.640241:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787786421.640243:0:8713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aaca00, rc 0) 00000100:00100000:2.0:1787786421.640312:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237b51e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+46:10425:x1874629667882624:12345-192.168.204.34@tcp:101:bash.0 Request processed in 5939us (6331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786421.640321:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 59 00000100:00100000:0.0:1787786421.640643:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bfdde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:173d08e0-0e54-474e-858e-1679cd38cf14+45:2365:x1874629667882752:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 901us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786421.640651:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 41 00000100:00100000:3.0:1787786421.644387:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786421.644634:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667883008 00000100:00100000:0.0:1787786421.644648:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667883008 00000100:00100000:0.0:1787786421.644725:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 15 00000100:00100000:0.0:1787786421.644737:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52062fd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+45:10425:x1874629667883008:12345-192.168.204.34@tcp:35:bash.0 00000100:00100000:0.0:1787786421.645117:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52062fd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+46:10425:x1874629667883008:12345-192.168.204.34@tcp:35:bash.0 Request processed in 381us (749us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1787786421.645127:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 15 00010000:00010000:1.0:1787786421.706025:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786421.722498:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786421.722920:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667883264 00000100:00100000:3.0:1787786421.722929:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667883264 00000100:00100000:3.0:1787786421.723002:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 60 00000100:00100000:3.0:1787786421.723012:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bfdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+46:10435:x1874629667883264:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:3.0:1787786421.723037:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786421.723057:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2570 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7522a6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786421.723185:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787786421.723320:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2570 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522a6 expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786421.723353:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5204e6f000) 00010000:00010000:3.0:1787786421.723356:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787786421.723361:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2570 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522a6 expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786421.723376:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb7600, rc 0) 00000100:00100000:3.0:1787786421.723450:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bfdd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+47:10435:x1874629667883264:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 439us (965us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1787786421.723457:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 60 00000100:00100000:1.0:1787786421.729034:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786421.729240:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667883392 00000100:00100000:2.0:1787786421.729250:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667883392 00000100:00100000:2.0:1787786421.729325:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 61 00000100:00100000:2.0:1787786421.729337:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bfded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+47:10435:x1874629667883392:12345-192.168.204.34@tcp:34:lfs.0 00010000:00010000:2.0:1787786421.729422:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff257e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.729452:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff257e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.729479:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff257e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.729495:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2585 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.729501:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.729507:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.729609:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff258c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.729619:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff258c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.729626:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff258c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787786421.729669:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff258c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.729682:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff257e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.729688:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff257e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.729694:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff257e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.729710:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aad400 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786421.729715:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff257e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.729723:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff257e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.729735:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b52100f1600) 00010000:00010000:2.0:1787786421.729738:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786421.729742:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff257e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.729748:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff257e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.729761:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.729766:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2585 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.729771:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2585 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.729775:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aacc00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786421.729778:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2585 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.729783:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2585 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.729854:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b5210c81400) 00010000:00010000:2.0:1787786421.729857:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786421.729860:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2585 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.729866:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2585 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.729879:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff258c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.729885:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff258c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.729890:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff258c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.729895:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aad000 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786421.729898:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff258c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.729903:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff258c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.729910:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b52100f1200) 00010000:00010000:2.0:1787786421.729912:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786421.729915:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff258c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.729921:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff258c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786421.730008:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bfded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+47:10435:x1874629667883392:12345-192.168.204.34@tcp:34:lfs.0 Request processed in 673us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786421.730016:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 61 00000100:00100000:1.0:1787786421.734573:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786421.734653:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667883648 00000100:00100000:0.0:1787786421.734664:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667883648 00000100:00100000:0.0:1787786421.734725:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 16 00000100:00100000:0.0:1787786421.734734:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bfdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+47:10435:x1874629667883648:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:0.0:1787786421.735029:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bfdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+48:10435:x1874629667883648:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 295us (469us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1787786421.735036:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 16 00000100:00100000:2.0:1787786421.765951:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786421.766102:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667883904 00000100:00100000:1.0:1787786421.766113:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667883904 00000100:00100000:1.0:1787786421.766173:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 62 00000100:00100000:1.0:1787786421.766183:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a36580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+48:10438:x1874629667883904:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:1.0:1787786421.766209:0:8713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786421.766230:0:8713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff2593 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7522ad expref: -99 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.766319:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff259a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.766335:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff259a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.766361:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff259a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.766378:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff25a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.766386:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff25a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.766393:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff25a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.766527:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff25a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.766536:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff25a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.766543:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff25a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787786421.766552:0:8713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787786421.766663:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff259a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.766671:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff259a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.766677:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff259a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.766682:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d9c00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786421.766692:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff259a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.766700:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff259a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.766712:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b52100f1600) 00010000:00010000:1.0:1787786421.766715:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787786421.766720:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff259a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.766726:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff259a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.766739:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff25a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.766746:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff25a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.766752:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff25a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.766756:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d9400 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786421.766759:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff25a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.766764:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff25a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.766771:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b52100f1400) 00010000:00010000:1.0:1787786421.766772:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787786421.766782:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff25a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.766845:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff25a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.766892:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff2593 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522ad expref: 51 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.766906:0:8713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff25a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522ad expref: 50 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.766912:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b52100f1200) 00010000:00010000:1.0:1787786421.766915:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787786421.766917:0:8713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523b4d8a00, rc 0) 00000100:00100000:1.0:1787786421.766986:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a36580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+50:10438:x1874629667883904:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 803us (1046us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1787786421.766993:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 62 00000100:00100000:1.0:1787786421.774700:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786421.774837:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786421.775542:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667884160 00000100:00100000:2.0:1787786421.775553:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667884160 00000100:00100000:2.0:1787786421.775622:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 63 00000100:00100000:2.0:1787786421.775632:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bfdcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+50:10438:x1874629667884160:12345-192.168.204.34@tcp:54:lfs.0 00010000:00010000:2.0:1787786421.775709:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff25b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.775726:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff25b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.775737:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff25b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.775766:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff25b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.775772:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff25b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.775778:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff25b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.775784:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aacc00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786421.775826:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff25b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.775854:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff25b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.775866:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b52100f1200) 00010000:00010000:2.0:1787786421.775869:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787786421.775873:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff25b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.775879:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff25b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786421.775952:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bfdcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+50:10438:x1874629667884160:12345-192.168.204.34@tcp:54:lfs.0 Request processed in 322us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786421.775960:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 63 00000100:00100000:0.0:1787786421.777708:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667884032 00000100:00100000:0.0:1787786421.777719:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667884032 00000100:00100000:0.0:1787786421.777772:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 4 00000100:00100000:0.0:1787786421.777985:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bfdc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+50:2364:x1874629667884032:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787786421.778003:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787786421.778026:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff25a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522ad expref: 50 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786421.778041:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b52100f1200) 00010000:00010000:0.0:1787786421.778045:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787786421.778130:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bfdc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+49:2364:x1874629667884032:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 350us (3442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786421.778153:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 4 00000100:00100000:1.0:1787786421.783173:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786421.783451:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667884416 00000100:00100000:0.0:1787786421.783463:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667884416 00000100:00100000:0.0:1787786421.783536:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 17 00000100:00100000:0.0:1787786421.783546:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bfdcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+49:10438:x1874629667884416:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:0.0:1787786421.783816:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bfdcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+50:10438:x1874629667884416:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 271us (653us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1787786421.783823:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 17 00000100:00100000:2.0:1787786421.904608:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786421.904777:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667884672 00000100:00100000:3.0:1787786421.904819:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667884672 00000100:00100000:3.0:1787786421.904884:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 64 00000100:00100000:3.0:1787786421.904894:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a35680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+50:10456:x1874629667884672:12345-192.168.204.34@tcp:101:cat.0 00010000:00010000:3.0:1787786421.904919:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786421.904940:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff25bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7522b4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786421.905044:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff25c4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786421.905060:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff25c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786421.905070:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff25c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786421.905081:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787786421.905234:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff25bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522b4 expref: 53 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786421.905255:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff25c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522b4 expref: 52 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786421.905264:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b52100f1200) 00010000:00010000:3.0:1787786421.905267:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1787786421.905271:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb7e00, rc 0) 00000100:00100000:3.0:1787786421.905357:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a35680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+52:10456:x1874629667884672:12345-192.168.204.34@tcp:101:cat.0 Request processed in 463us (756us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1787786421.905365:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 64 00000100:00100000:2.0:1787786421.932599:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786421.932864:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667884800 00000100:00100000:3.0:1787786421.932875:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667884800 00000100:00100000:3.0:1787786421.932935:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 65 00000100:00100000:3.0:1787786421.932948:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+52:10457:x1874629667884800:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:3.0:1787786421.932985:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786421.933016:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff25d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7522bb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786421.933110:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff25d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786421.933138:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff25d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786421.933149:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff25d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786421.933240:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787786421.933244:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787786421.933267:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff25d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786421.933309:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff25d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522bb expref: 54 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786421.933328:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff25d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522bb expref: 53 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786421.933337:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b52100f1600) 00010000:00010000:3.0:1787786421.933340:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787786421.933343:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb6a00, rc 0) 00000100:00100000:3.0:1787786421.933404:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+53:10457:x1874629667884800:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 459us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786421.933412:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 65 00000100:00100000:0.0:1787786421.940384:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786421.940513:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667885184 00000100:00100000:1.0:1787786421.940522:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667885184 00000100:00100000:1.0:1787786421.940643:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 18 00000100:00100000:1.0:1787786421.940654:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+53:10457:x1874629667885184:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:1.0:1787786421.941033:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+54:10457:x1874629667885184:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 380us (657us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1787786421.941041:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 18 00000100:00100000:2.0:1787786421.944954:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786421.945050:0:8508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667885312 00000100:00100000:1.0:1787786421.945059:0:8508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667885312 00000100:00100000:1.0:1787786421.945150:0:8508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 5 00000100:00100000:1.0:1787786421.945159:0:8508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a37840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:173d08e0-0e54-474e-858e-1679cd38cf14+54:10457:x1874629667885312:12345-192.168.204.34@tcp:103:lfs.0 00010000:00010000:1.0:1787786421.945173:0:8508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787786421.945197:0:8508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2569 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75229f expref: 54 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.945214:0:8508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff25c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522b4 expref: 53 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.945223:0:8508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201677400/0x450132973bff2474 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752260 expref: 52 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.945230:0:8508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b52100f1200) 00010000:00010000:1.0:1787786421.945238:0:8508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786421.945336:0:8508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a37840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:173d08e0-0e54-474e-858e-1679cd38cf14+51:10457:x1874629667885312:12345-192.168.204.34@tcp:103:lfs.0 Request processed in 177us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786421.945344:0:8508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 5 00000100:00100000:3.0:1787786421.947018:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786421.947062:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667885440 00000100:00100000:1.0:1787786421.947070:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667885440 00000100:00100000:1.0:1787786421.947120:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 66 00000100:00100000:1.0:1787786421.947140:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237b512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+51:10457:x1874629667885440:12345-192.168.204.34@tcp:58:lfs.0 00010000:00010000:1.0:1787786421.947275:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff25e0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.947290:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff25e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786421.947329:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff25e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787786421.947643:0:5847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787786421.947922:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1787786421.947988:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1787786421.948097:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237b512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+51:10457:x1874629667885440:12345-192.168.204.34@tcp:58:lfs.0 Request processed in 966us (1084us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786421.948107:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 66 00000040:00080000:0.0:1787786421.962541:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787786421.962550:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787786421.962593:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787786421.962601:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787786421.962741:0:11693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360cb40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874629686784384:192.168.204.34@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787786421.962864:0:11693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5206dcdb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787786421.965502:0:11693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360cb40 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874629686784384:192.168.204.34@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787786421.967495:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786421.967942:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667885568 00000100:00100000:0.0:1787786421.967962:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667885568 00000100:00100000:0.0:1787786421.968045:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 1 00000100:00100000:0.0:1787786421.968055:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a37c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:173d08e0-0e54-474e-858e-1679cd38cf14+51:10462:x1874629667885568:12345-192.168.204.34@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1787786421.968150:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a37c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:173d08e0-0e54-474e-858e-1679cd38cf14+51:10462:x1874629667885568:12345-192.168.204.34@tcp:900:lhsmtool_posix.0 Request processed in 96us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786421.968157:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 1 00000100:00100000:1.0:1787786421.968713:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786421.968822:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667885696 00000100:00100000:2.0:1787786421.968828:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667885696 00000100:00100000:2.0:1787786421.968864:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 67 00000100:00100000:2.0:1787786421.968875:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bfde580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+51:10459:x1874629667885696:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:2.0:1787786421.968886:0:8713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786421.968959:0:8713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff25e7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7522c2 expref: -99 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.969026:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff25ee lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.969056:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff25ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.969068:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff25ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.969084:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff25f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.969090:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff25f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.969096:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff25f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.969187:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff25fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.969196:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff25fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.969203:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff25fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786421.969238:0:8713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787786421.969242:0:8713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787786421.969262:0:8713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff25fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.969275:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff25fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.969303:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff25ee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.969310:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff25ee lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.969317:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff25ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.969323:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aad400 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786421.969327:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff25ee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.969333:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff25ee lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.969345:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b52100f1600) 00010000:00010000:2.0:1787786421.969348:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786421.969352:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff25ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.969358:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff25ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.969370:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff25f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.969377:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff25f5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.969382:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff25f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.969392:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aad000 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786421.969395:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff25f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.969401:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff25f5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.969407:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b5210c81400) 00010000:00010000:2.0:1787786421.969410:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786421.969412:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff25f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.969418:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff25f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.969449:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff25e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522c2 expref: 53 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.969461:0:8713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff25fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522c2 expref: 52 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.969468:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b52100f1400) 00010000:00010000:2.0:1787786421.969471:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787786421.969473:0:8713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aac400, rc 0) 00000100:00100000:2.0:1787786421.969516:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bfde580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+52:10459:x1874629667885696:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 643us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786421.969522:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 67 00000100:00100000:0.0:1787786421.970722:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786421.971735:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667885824 00000100:00100000:3.0:1787786421.971748:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667885824 00000100:00100000:3.0:1787786421.971820:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 68 00000100:00100000:3.0:1787786421.971841:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+52:10462:x1874629667885824:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787786421.971877:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787786421.971987:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+52:10462:x1874629667885824:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 Request processed in 157us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786421.971996:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 68 00000100:00100000:1.0:1787786421.974204:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786421.974465:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667885952 00000100:00100000:2.0:1787786421.974485:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667885952 00000100:00100000:2.0:1787786421.974540:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 69 00000100:00100000:2.0:1787786421.974549:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bfdd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+52:10462:x1874629667885952:12345-192.168.204.34@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787786421.974606:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2603 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.974619:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2603 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.974627:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2603 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.974637:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff260a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.974642:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff260a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.974646:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff260a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.974664:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2611 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.974669:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.974673:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786421.974705:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787786421.974709:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787786421.974730:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.974743:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2603 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.974749:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2603 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.974756:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2603 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.974762:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aad600 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786421.974766:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2603 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.974774:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2603 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.974787:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b5210c81800) 00010000:00010000:2.0:1787786421.976693:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786421.976702:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2603 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.976713:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2603 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.976735:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff260a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.976742:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff260a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.976749:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff260a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.976771:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aad200 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786421.976775:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff260a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.976782:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff260a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.976897:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8b5210c81600) 00010000:00010000:2.0:1787786421.976902:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786421.976906:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff260a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.976913:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff260a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.976932:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2611 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.976938:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2611 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.976944:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2611 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.976950:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aad800 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786421.976952:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2611 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.976958:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2611 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.976978:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b52100f1400) 00010000:00010000:2.0:1787786421.976980:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786421.976984:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2611 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.976989:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2611 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786421.977089:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bfdd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+52:10462:x1874629667885952:12345-192.168.204.34@tcp:34:lhsmtool_posix.0 Request processed in 2535us (2886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786421.977100:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 69 00000100:00100000:0.0:1787786421.978760:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786421.978877:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667886208 00000100:00100000:2.0:1787786421.978888:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667886208 00000100:00100000:2.0:1787786421.978995:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 70 00000100:00100000:2.0:1787786421.979005:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+52:10462:x1874629667886208:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787786421.979041:0:8713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786421.979061:0:8713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2618 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7522c9 expref: -99 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.979157:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff261f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.979177:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff261f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.979189:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff261f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786421.979201:0:8713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787786421.979341:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff261f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.979359:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff261f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.979365:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff261f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.979372:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aad000 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786421.979376:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff261f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.979384:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff261f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.979402:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b52100f1400) 00010000:00010000:2.0:1787786421.979405:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787786421.979409:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff261f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.979416:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff261f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.979455:0:8713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2618 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522c9 expref: 54 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.979465:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b5210c81800) 00010000:00010000:2.0:1787786421.979468:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787786421.979471:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2618 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522c9 expref: 54 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.979491:0:8713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aada00, rc 0) 00000100:00100000:2.0:1787786421.979555:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+53:10462:x1874629667886208:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 551us (801us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1787786421.979562:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 70 00000100:00100000:0.0:1787786421.983493:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786421.983620:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667886336 00000100:00100000:3.0:1787786421.983628:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667886336 00000100:00100000:3.0:1787786421.983688:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 71 00000100:00100000:3.0:1787786421.983698:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+53:10462:x1874629667886336:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787786421.983767:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787786421.984146:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+53:10462:x1874629667886336:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 Request processed in 447us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786421.984154:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 71 00000100:00100000:1.0:1787786421.987943:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786421.988049:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667886592 00000100:00100000:2.0:1787786421.988060:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667886592 00000100:00100000:2.0:1787786421.988136:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 72 00000100:00100000:2.0:1787786421.988148:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bfde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+53:10462:x1874629667886592:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787786421.988171:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786421.988185:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787786421.988214:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff25d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522bb expref: 53 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.988233:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b52100f1600) 00010000:00010000:2.0:1787786421.988238:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787786421.988252:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff262d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7522d0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787786421.989260:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1787786421.989484:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2634 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.989500:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2634 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.989575:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2634 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.989652:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff262d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522d0 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.989737:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2634 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522d0 expref: 54 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.989746:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8b5210c81600) 00010000:00010000:2.0:1787786421.989748:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787786421.989751:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aad200, rc 0) 00000100:00100000:2.0:1787786421.989932:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bfde1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+54:10462:x1874629667886592:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 1786us (2000us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1787786421.989942:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 72 00000100:00100000:0.0:1787786421.996555:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786421.996642:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667886848 00000100:00100000:2.0:1787786421.996651:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667886848 00000100:00100000:2.0:1787786421.996703:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 73 00000100:00100000:2.0:1787786421.996714:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+54:10462:x1874629667886848:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787786421.996777:0:8713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787786421.996832:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2634 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522d0 expref: 54 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.996852:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8b5210c81600) 00010000:00010000:2.0:1787786421.996863:0:8713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787786421.996885:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2642 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.996899:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2642 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.996923:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2642 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.996939:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2649 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x45888c06 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.996947:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2649 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x45888c06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.996954:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2649 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x45888c06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.997039:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2642 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.997047:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2642 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.997053:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2642 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.997060:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aada00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786421.997064:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2642 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.997071:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2642 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.997080:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b52100f1600) 00010000:00010000:2.0:1787786421.997083:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786421.997087:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2642 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.997100:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2642 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.997110:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2649 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x45888c06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.997116:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2649 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x45888c06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.997133:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2649 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x45888c06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.997139:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aad000 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786421.997142:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2649 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x45888c06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.997148:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2649 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x45888c06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.997156:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x45888c06 (ffff8b5210c81400) 00010000:00010000:2.0:1787786421.997159:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786421.997162:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2649 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x45888c06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786421.997168:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2649 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x45888c06 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786421.997265:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+53:10462:x1874629667886848:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 Request processed in 551us (719us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787786421.997273:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 73 00000100:00100000:0.0:1787786422.007244:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786422.007329:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667886976 00000100:00100000:3.0:1787786422.007338:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667886976 00000100:00100000:3.0:1787786422.007395:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 74 00000100:00100000:3.0:1787786422.007405:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523298bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+53:10462:x1874629667886976:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787786422.007434:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786422.007459:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2650 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7522d7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.007495:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff2657 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.007508:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff2657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.007518:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff2657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.007619:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2650 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522d7 expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.007638:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff2657 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522d7 expref: 54 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.007654:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8b5204e6f200) 00010000:00010000:3.0:1787786422.007658:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787786422.007662:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb6800, rc 0) 00000100:00100000:3.0:1787786422.007730:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523298bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+54:10462:x1874629667886976:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 327us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786422.007738:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 74 00000100:00100000:0.0:1787786422.017280:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786422.017415:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667887232 00000100:00100000:2.0:1787786422.017424:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667887232 00000100:00100000:2.0:1787786422.017496:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 75 00000100:00100000:2.0:1787786422.017507:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bffbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+54:10462:x1874629667887232:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787786422.018324:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff265e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.018343:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff265e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.018356:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff265e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787786422.018708:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:2.0:1787786422.018719:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 348376927626ns, next at 349376925347ns, rc = 0 00000004:00010000:2.0:1787786422.018827:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d90929cf reply state 0000000026e1dc63 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff265e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786422.022142:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787786422.022498:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bffbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+56:10462:x1874629667887232:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 Request processed in 4988us (5221us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1787786422.022507:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 75 00010000:00010000:0.0:1787786422.027425:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff265e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.027444:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff265e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.027453:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff265e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.027460:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aad000 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786422.027465:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff265e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.027472:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff265e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.027492:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8b5204e6f200) 00010000:00010000:0.0:1787786422.027495:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787786422.027500:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff265e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.027507:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff265e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786422.030751:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786422.031436:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667887360 00000100:00100000:2.0:1787786422.031449:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667887360 00000100:00100000:2.0:1787786422.031508:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 76 00000100:00100000:2.0:1787786422.031519:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bfdf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+55:10462:x1874629667887360:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787786422.031544:0:7644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786422.031568:0:7644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2665 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7522de expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.031652:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2665 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522de expref: 56 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.031666:0:7644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2665 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522de expref: 56 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.031685:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8b5204e6f200) 00010000:00010000:2.0:1787786422.031688:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787786422.031691:0:7644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aada00, rc 0) 00000100:00100000:2.0:1787786422.031762:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bfdf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+56:10462:x1874629667887360:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 245us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786422.031769:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 76 00000100:00100000:1.0:1787786422.036199:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786422.037769:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667887488 00000100:00100000:3.0:1787786422.037781:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667887488 00000100:00100000:3.0:1787786422.037867:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 24 00000100:00100000:3.0:1787786422.037876:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bfdfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2361:x1874629667887488:12345-192.168.204.34@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1787786422.038012:0:6700:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 173d08e0-0e54-474e-858e-1679cd38cf14@192.168.204.34@tcp t0 exp 0000000000000000 cur 348 last 0 00000020:00000080:2.0:1787786422.038045:0:6700:0:(genops.c:1385:class_connect()) connect: client 173d08e0-0e54-474e-858e-1679cd38cf14, cookie 0x450132973bff266c 00002000:00100000:2.0:1787786422.038058:0:6700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 173d08e0-0e54-474e-858e-1679cd38cf14/ffff8b52112fc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113935 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787786422.038068:0:6700:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787786422.038326:0:6700:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787786422.038362:0:6700:0:(import.c:65:import_set_state_nolock()) ffff8b52112f9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787786422.038450:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bfdfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:173d08e0-0e54-474e-858e-1679cd38cf14+6:2361:x1874629667887488:12345-192.168.204.34@tcp:8:lhsmtool_posix.0 Request processed in 573us (2259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786422.038458:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 24 00000100:00100000:0.0:1787786422.044727:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786422.045131:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667887616 00000100:00100000:1.0:1787786422.045141:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667887616 00000100:00100000:1.0:1787786422.045205:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 25 00000100:00100000:1.0:1787786422.045215:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:173d08e0-0e54-474e-858e-1679cd38cf14+6:0:x1874629667887616:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787786422.045427:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787786422.113137:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:173d08e0-0e54-474e-858e-1679cd38cf14+7:0:x1874629667887616:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 Request processed in 67907us (68405us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787786422.113151:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 25 00000001:00080000:3.0:1787786422.114847:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:3.0:1787786422.114864:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 173d08e0-0e54-474e-858e-1679cd38cf14 00000100:00100000:0.0:1787786422.120681:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786422.121176:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667887872 00000100:00100000:2.0:1787786422.121187:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667887872 00000100:00100000:2.0:1787786422.121283:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 19 00000100:00100000:2.0:1787786422.121305:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523333a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+56:10462:x1874629667887872:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787786422.121555:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523333a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+57:10462:x1874629667887872:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 Request processed in 263us (886us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1787786422.121564:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 19 00000100:00100000:2.0:1787786422.124592:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786422.124660:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667888128 00000100:00100000:0.0:1787786422.124894:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667888128 00000100:00100000:0.0:1787786422.124962:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 77 00000100:00100000:0.0:1787786422.124972:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a36940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+57:10462:x1874629667888128:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787786422.125074:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a36940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+57:10462:x1874629667888128:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 104us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786422.125081:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 77 00000100:00100000:0.0:1787786422.131955:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786422.132093:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667888256 00000100:00100000:2.0:1787786422.132104:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667888256 00000100:00100000:2.0:1787786422.132168:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 78 00000100:00100000:2.0:1787786422.132178:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b522349cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+57:10462:x1874629667888256:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787786422.132199:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786422.132219:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2673 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7522e5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.132301:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff267a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.132315:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff267a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.132327:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff267a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786422.132363:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787786422.132383:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff267a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.132410:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2673 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522e5 expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.132428:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff267a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522e5 expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.132444:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8b5204e6f200) 00010000:00010000:2.0:1787786422.132447:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787786422.132451:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aad800, rc 0) 00000100:00100000:2.0:1787786422.132513:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b522349cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+58:10462:x1874629667888256:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 337us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786422.132521:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 78 00000100:00100000:0.0:1787786422.143610:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786422.147322:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667888384 00000100:00100000:1.0:1787786422.147336:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667888384 00000100:00100000:1.0:1787786422.147483:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 26 00000100:00100000:1.0:1787786422.147494:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b522349f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+5:2364:x1874629667888384:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787786422.147512:0:8126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786422.147545:0:8126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bac21a1f/0x450132973bff2681 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7522ec expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787786422.147574:0:8126:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f74b6, blocks: 0x1 00010000:00010000:1.0:1787786422.147596:0:8126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=348s v=(0 0) 00010000:00010000:1.0:1787786422.147601:0:8126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786422.147610:0:8126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bac21a1f/0x450132973bff2681 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522ec expref: 6 pid: 8126 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.148055:0:8126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bac21a1f/0x450132973bff2681 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522ec expref: 6 pid: 8126 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.148072:0:8126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523b4d9200, rc 0) 00000100:00100000:1.0:1787786422.148141:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b522349f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+6:2364:x1874629667888384:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 649us (4541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786422.148149:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 26 00000100:00100000:0.0:1787786422.154922:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786422.154996:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667888640 00000100:00100000:3.0:1787786422.155014:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667888640 00000100:00100000:3.0:1787786422.155100:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 79 00000100:00100000:3.0:1787786422.155113:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206352d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+58:10462:x1874629667888640:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787786422.155281:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206352d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+58:10462:x1874629667888640:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 170us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786422.155300:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 79 00000100:00100000:3.0:1787786422.162866:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786422.163008:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667888768 00000100:00100000:1.0:1787786422.163021:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667888768 00000100:00100000:1.0:1787786422.163104:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 27 00000100:00100000:1.0:1787786422.163116:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237b530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+6:10462:x1874629667888768:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787786422.163140:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786422.163163:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d26cf718/0x450132973bff2688 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7522f3 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.163204:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bac21a1f/0x450132973bff2681 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522ec expref: 7 pid: 8126 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.163234:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786422.163239:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786422.163245:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d26cf718/0x450132973bff2688 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522f3 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.163308:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bac21a1f/0x450132973bff2681 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522ec expref: 7 pid: 8126 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.163324:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bac21a1f/0x450132973bff2681 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522ec expref: 7 pid: 8126 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786422.163342:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bfdda40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6699:1874629686784512:192.168.204.34@tcp:104: 00000100:00100000:1.0:1787786422.163478:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5203e75cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787786422.174214:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786422.174301:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bfdda40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6699:1874629686784512:192.168.204.34@tcp:104: 00000100:00100000:2.0:1787786422.174308:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667888896 00000100:00100000:2.0:1787786422.174318:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667888896 00010000:00010000:3.0:1787786422.174350:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d26cf718/0x450132973bff2688 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522f3 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.174369:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bac21a1f/0x450132973bff2681 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522ec expref: 8 pid: 8126 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.174405:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523b4d8800, rc 0) 00000100:00100000:2.0:1787786422.174431:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 42 00000100:00100000:2.0:1787786422.174444:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5211bfb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:173d08e0-0e54-474e-858e-1679cd38cf14+8:2364:x1874629667888896:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787786422.174474:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1787786422.174478:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237b530c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+8:10462:x1874629667888768:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 11362us (11623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786422.174489:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 27 00010000:00010000:2.0:1787786422.174505:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bac21a1f/0x450132973bff2681 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522ec expref: 8 pid: 8126 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.174522:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bac21a1f/0x450132973bff2681 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522ec expref: 7 pid: 8126 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.174556:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bac21a1f/0x450132973bff2681 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522ec expref: 7 pid: 8126 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.174572:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787786422.174585:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787786422.174595:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d26cf718/0x450132973bff2688 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522f3 expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.174608:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d26cf718/0x450132973bff2688 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522f3 expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.174657:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d26cf718/0x450132973bff2688 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522f3 expref: 6 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786422.174673:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237a352c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5831:1874629686784640:192.168.204.34@tcp:105: 00000100:00100000:2.0:1787786422.174742:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52328bd840 going to sleep for 11 seconds 00000100:00100000:2.0:1787786422.180753:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237a352c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5831:1874629686784640:192.168.204.34@tcp:105: 00010000:00010000:2.0:1787786422.180819:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787786422.180896:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5211bfb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:173d08e0-0e54-474e-858e-1679cd38cf14+6:2364:x1874629667888896:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 6453us (6694us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786422.180911:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 42 00000100:00100000:3.0:1787786422.181138:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786422.181658:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667889024 00000100:00100000:2.0:1787786422.181669:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667889024 00002000:00100000:2.0:1787786422.181726:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8b5237b50780 x1874629667889024/t0(0) o4->173d08e0-0e54-474e-858e-1679cd38cf14@192.168.204.34@tcp:38/0 lens 504/0 e 0 to 0 dl 1787786433 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787786422.181738:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8b5237b50780 with x1874629667889024 ext(0->8) 00002000:00010000:2.0:1787786422.181743:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b5237b50780 00000100:00100000:2.0:1787786422.181777:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 0 00000100:00100000:2.0:1787786422.181814:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237b50780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:173d08e0-0e54-474e-858e-1679cd38cf14+6:2364:x1874629667889024:12345-192.168.204.34@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787786422.186427:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237b50780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:173d08e0-0e54-474e-858e-1679cd38cf14+8:2364:x1874629667889024:12345-192.168.204.34@tcp:4:lhsmtool_posix.0 Request processed in 4630us (5279us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1787786422.186442:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 0 00002000:00100000:2.0:1787786422.186456:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8b5237b50780 x1874629667889024/t4294967302(0) o4->173d08e0-0e54-474e-858e-1679cd38cf14@192.168.204.34@tcp:38/0 lens 504/448 e 0 to 0 dl 1787786433 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787786422.186466:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8b5237b50780 with x1874629667889024 ext(0->8) 00002000:00010000:2.0:1787786422.186472:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b5237b50780 00000100:00100000:3.0:1787786422.190172:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786422.190724:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667889152 00000100:00100000:2.0:1787786422.190743:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667889152 00000100:00100000:2.0:1787786422.190837:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 80 00000100:00100000:2.0:1787786422.190848:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237b50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+58:10462:x1874629667889152:12345-192.168.204.34@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787786422.254319:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237b50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+58:10462:x1874629667889152:12345-192.168.204.34@tcp:44:lhsmtool_posix.0 Request processed in 63461us (64150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786422.254333:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 80 00000001:00080000:3.0:1787786422.260922:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967348 is committed 00000001:00080000:3.0:1787786422.260973:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000004:00080000:3.0:1787786422.260987:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1787786422.261013:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1787786422.261019:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1787786422.261043:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b52328bd240 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1787786422.261048:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8b523b4da100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b52328bd540 00000020:00080000:3.0:1787786422.261051:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8b523b4da700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b5202f60000 00000100:00100000:0.0:1787786422.261474:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52063530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686784768:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787786422.261540:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1787786422.262083:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:1.0:1787786422.262199:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000020:00080000:3.0:1787786422.262205:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1787786422.262211:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bfdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686784896:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787786422.262244:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786422.262478:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686784768 00000100:00100000:3.0:1787786422.262485:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686784768 00000100:00100000:3.0:1787786422.262534:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686784896 00000100:00100000:3.0:1787786422.262538:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686784896 00000100:00100000:3.0:1787786422.262570:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787786422.262580:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206352940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686784768:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787786422.262609:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787786422.262623:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bfdde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1874629686784896:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787786422.262637:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1787786422.262666:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a8f74b4, atime: 0x6a8f74b4, ctime: 0x6a8f74b4, blocks: 0x1 00010000:00010000:1.0:1787786422.262686:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2a032dd/0x450132973bff268f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787786422.262727:0:8126:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787786422.262730:0:8126:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787786422 00002000:00010000:3.0:1787786422.262733:0:8126:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787786422.262741:0:8126:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787786422 -> 1787786422 00002000:00010000:3.0:1787786422.262743:0:8126:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787786422.263802:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206352940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1874629686784768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1208us (2246us total) trans 4294967303 rc 0/0 00010000:00010000:1.0:1787786422.263811:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=348s v=(0 0) 00000100:00100000:3.0:1787786422.263812:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:1.0:1787786422.263815:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786422.263822:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2a032dd/0x450132973bff268f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.263840:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2a032dd/0x450132973bff268f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787786422.263841:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787786422.263850:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2a032dd/0x450132973bff268f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.263857:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2a032dd/0x450132973bff268f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.263874:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1787786422.263883:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b52063530c0/2, rc 0, transno 4294967303 00000100:00100000:3.0:1787786422.263889:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52063530c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686784768:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1787786422.264107:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787786422.264117:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2a032dd/0x450132973bff268f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.264125:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d9e00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:0.0:1787786422.264130:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2a032dd/0x450132973bff268f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.264140:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2a032dd/0x450132973bff268f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.264157:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2a032dd/0x450132973bff268f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.264175:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2a032dd/0x450132973bff268f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.264194:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786422.264195:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786422.264197:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786422.264544:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bfdde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1874629686784896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1921us (2297us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1787786422.264552:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787786422.270085:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786422.270690:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667889280 00000100:00100000:3.0:1787786422.270701:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667889280 00000100:00100000:3.0:1787786422.270754:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 30 00000100:00100000:3.0:1787786422.270765:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bfdc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:173d08e0-0e54-474e-858e-1679cd38cf14+8:2365:x1874629667889280:12345-192.168.204.34@tcp:16:lhsmtool_posix.0 00000004:00080000:0.0:1787786422.275943:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b523bfdf480/2, rc 0, transno 4294967301 00000100:00100000:0.0:1787786422.275960:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bfdf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686784896:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787786422.282305:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787786422.282331:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237a37840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686785024:0@lo:400:kworker.0 00000100:00100000:0.0:1787786422.282414:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786422.282701:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686785024 00000100:00100000:3.0:1787786422.282710:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686785024 00000100:00100000:3.0:1787786422.282766:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1787786422.282785:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3313:x1874629686785024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786422.282860:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3313:x1874629686785024:12345-0@lo:400:kworker.0 Request processed in 77us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786422.282868:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1787786422.283162:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237a37840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686785024:0@lo:400:kworker.0 00000100:00100000:0.0:1787786422.283642:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237a35a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874629686785408:0@lo:400:kworker.0 00000100:00100000:0.0:1787786422.283687:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786422.283864:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237a352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874629686785152:0@lo:400:kworker.0 00000100:00100000:0.0:1787786422.283889:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786422.283909:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787786422.283914:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237a370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874629686785280:0@lo:400:kworker.0 00000100:00100000:0.0:1787786422.283934:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786422.283972:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686785408 00000100:00100000:0.0:1787786422.283977:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686785408 00000100:00100000:0.0:1787786422.284015:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686785152 00000100:00100000:0.0:1787786422.284017:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686785152 00000100:00100000:0.0:1787786422.284031:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686785280 00000100:00100000:0.0:1787786422.284033:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686785280 00000100:00100000:0.0:1787786422.284063:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787786422.284070:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206351680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874629686785408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786422.284108:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206351680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874629686785408:12345-0@lo:400:kworker.0 Request processed in 39us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786422.284114:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787786422.284125:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787786422.284130:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874629686785152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786422.284153:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874629686785152:12345-0@lo:400:kworker.0 Request processed in 23us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786422.284158:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787786422.284167:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787786422.284171:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206351a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874629686785280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786422.284190:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206351a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874629686785280:12345-0@lo:400:kworker.0 Request processed in 19us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786422.284195:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1787786422.284227:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237a35a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874629686785408:0@lo:400:kworker.0 00000100:00100000:0.0:1787786422.284245:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237a370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874629686785280:0@lo:400:kworker.0 00000100:00100000:0.0:1787786422.284252:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237a352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874629686785152:0@lo:400:kworker.0 00000100:00080000:0.0:1787786422.284264:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787786422.328304:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bfdc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:173d08e0-0e54-474e-858e-1679cd38cf14+8:2365:x1874629667889280:12345-192.168.204.34@tcp:16:lhsmtool_posix.0 Request processed in 57520us (58208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786422.328320:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 30 00000001:00080000:0.0:1787786422.331209:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:0.0:1787786422.331241:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1787786422.331657:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786422.331720:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667889536 00000100:00100000:2.0:1787786422.331733:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667889536 00000100:00100000:2.0:1787786422.331833:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 81 00000100:00100000:2.0:1787786422.331845:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237b50f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+13:10462:x1874629667889536:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787786422.331918:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787786422.332011:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff267a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522e5 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.332033:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8b5204e6f200) 00010000:00010000:2.0:1787786422.332038:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787786422.332088:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2696 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.332104:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2696 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.332115:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2696 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787786422.332631:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008fa28421 reply state 000000000e7ab5cd transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2696 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786422.332643:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787786422.332765:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237b50f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+14:10462:x1874629667889536:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 Request processed in 921us (1113us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1787786422.333044:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 81 00010000:00010000:0.0:1787786422.336745:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2696 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.336765:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2696 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.336781:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2696 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.336787:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aad600 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786422.336840:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2696 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.336850:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2696 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.336868:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8b5204e6f200) 00010000:00010000:0.0:1787786422.336872:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786422.336877:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2696 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.336885:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2696 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786422.343597:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786422.343847:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667889664 00000100:00100000:1.0:1787786422.343858:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667889664 00000100:00100000:1.0:1787786422.343912:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 31 00000100:00100000:1.0:1787786422.343923:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+6:2365:x1874629667889664:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787786422.344174:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787786422.344184:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787786422 -> 1787786421 00002000:00010000:1.0:1787786422.344187:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787786420 00002000:00010000:1.0:1787786422.344189:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787786422 -> 1787786421 00002000:00010000:1.0:1787786422.344192:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787786422.344248:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf84780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+7:2365:x1874629667889664:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 Request processed in 326us (657us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787786422.344255:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 31 00000100:00100000:0.0:1787786422.348584:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786422.349458:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667889920 00000100:00100000:1.0:1787786422.349470:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667889920 00000100:00100000:1.0:1787786422.349536:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 82 00000100:00100000:1.0:1787786422.349547:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+13:10462:x1874629667889920:12345-192.168.204.34@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787786422.349621:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9000/0x450132973bff269d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.349639:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff2657 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522d7 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.349649:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9000/0x450132973bff269d lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.349688:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff2657 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522d7 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.349704:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff2657 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522d7 expref: 13 pid: 5846 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786422.349719:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bfdda40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874629686785536:192.168.204.34@tcp:104: 00000100:00100000:1.0:1787786422.349836:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5203e75d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787786422.353507:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bfdda40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874629686785536:192.168.204.34@tcp:104: 00010000:00010000:1.0:1787786422.353542:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9000/0x450132973bff269d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786422.353669:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786422.353959:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667890048 00000100:00100000:1.0:1787786422.353966:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667890048 00010000:00010000:1.0:1787786422.354001:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff2657 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522d7 expref: 14 pid: 5846 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786422.354047:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 43 00000100:00100000:1.0:1787786422.354057:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237b52580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+14:2365:x1874629667890048:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787786422.354097:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786422.354106:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff2657 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522d7 expref: 14 pid: 5846 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.354119:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff2657 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522d7 expref: 14 pid: 5846 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.354142:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff2657 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522d7 expref: 14 pid: 5846 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.354157:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8b5204e6f200) 00010000:00010000:1.0:1787786422.354161:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9000/0x450132973bff269d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.354169:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9000/0x450132973bff269d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.354176:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9000/0x450132973bff269d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.354231:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786422.354307:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237b52580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+13:2365:x1874629667890048:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 250us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786422.354316:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 43 00010000:00010000:3.0:1787786422.354991:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9000/0x450132973bff269d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.355003:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9000/0x450132973bff269d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.355034:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9000/0x450132973bff269d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.355048:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9000/0x450132973bff269d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.355055:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9000/0x450132973bff269d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.355061:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d9000 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786422.355065:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9000/0x450132973bff269d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.355073:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9000/0x450132973bff269d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.355085:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8b5204e6f200) 00010000:00010000:3.0:1787786422.355088:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787786422.355092:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9000/0x450132973bff269d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.355101:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9000/0x450132973bff269d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786422.355156:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+12:10462:x1874629667889920:12345-192.168.204.34@tcp:55:lhsmtool_posix.0 Request processed in 5609us (6581us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787786422.355166:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 82 00000100:00100000:3.0:1787786422.363465:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786422.363848:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667890176 00000100:00100000:1.0:1787786422.363859:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667890176 00000100:00100000:1.0:1787786422.363975:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 32 00000100:00100000:1.0:1787786422.363987:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237b51680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+7:2363:x1874629667890176:12345-192.168.204.34@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787786422.364032:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000006e41621/0x450132973bff26a4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.364055:0:8126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d26cf718/0x450132973bff2688 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522f3 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.364116:0:8126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786422.364122:0:8126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787786422.364127:0:8126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006e41621/0x450132973bff26a4 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.364169:0:8126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d26cf718/0x450132973bff2688 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522f3 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.364185:0:8126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d26cf718/0x450132973bff2688 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522f3 expref: 7 pid: 6699 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786422.364203:0:8126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bfdda40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8126:1874629686785664:192.168.204.34@tcp:104: 00000100:00100000:1.0:1787786422.364320:0:8126:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5203e75d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787786422.375084:0:8126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bfdda40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8126:1874629686785664:192.168.204.34@tcp:104: 00010000:00010000:3.0:1787786422.375116:0:8126:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000006e41621/0x450132973bff26a4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786422.379524:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786422.380018:0:8508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667890304 00000100:00100000:2.0:1787786422.380030:0:8508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667890304 00010000:00010000:2.0:1787786422.380072:0:8508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d26cf718/0x450132973bff2688 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522f3 expref: 8 pid: 6699 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786422.380114:0:8508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 44 00000100:00100000:2.0:1787786422.380125:0:8508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237b521c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:173d08e0-0e54-474e-858e-1679cd38cf14+8:2364:x1874629667890304:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787786422.380141:0:8508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787786422.380166:0:8508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d26cf718/0x450132973bff2688 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522f3 expref: 8 pid: 6699 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.380194:0:8508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d26cf718/0x450132973bff2688 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522f3 expref: 8 pid: 6699 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.380239:0:8508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d26cf718/0x450132973bff2688 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522f3 expref: 8 pid: 6699 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.380256:0:8508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787786422.380260:0:8508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787786422.380266:0:8508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000006e41621/0x450132973bff26a4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.380277:0:8508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006e41621/0x450132973bff26a4 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.380315:0:8508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787786422.380508:0:8126:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000006e41621/0x450132973bff26a4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.380519:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006e41621/0x450132973bff26a4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.380546:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000006e41621/0x450132973bff26a4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.380554:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006e41621/0x450132973bff26a4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.380562:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006e41621/0x450132973bff26a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.380570:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d9400 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:3.0:1787786422.380575:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006e41621/0x450132973bff26a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.380584:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006e41621/0x450132973bff26a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.380598:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006e41621/0x450132973bff26a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.380618:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006e41621/0x450132973bff26a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786422.380671:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237b51680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+7:2363:x1874629667890176:12345-192.168.204.34@tcp:1:lhsmtool_posix.0 Request processed in 16686us (17216us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786422.380681:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 32 00000100:00100000:2.0:1787786422.381966:0:8508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237b521c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:173d08e0-0e54-474e-858e-1679cd38cf14+6:2364:x1874629667890304:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 1822us (2434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786422.381980:0:8508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 44 00000100:00100000:1.0:1787786422.385209:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786422.385306:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667890560 00000100:00100000:3.0:1787786422.385316:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667890560 00000100:00100000:3.0:1787786422.385380:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 83 00000100:00100000:3.0:1787786422.385390:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bfdda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+12:10462:x1874629667890560:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787786422.385471:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff26ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.385489:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff26ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.385501:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff26ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.385749:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff26b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.385761:0:7644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2665 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522de expref: 13 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.385770:0:7644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff26b2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.385851:0:7644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2665 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522de expref: 13 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.385867:0:7644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2665 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522de expref: 13 pid: 7644 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786422.385883:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237b53840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7644:1874629686785792:192.168.204.34@tcp:104: 00000100:00100000:3.0:1787786422.385968:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b4bed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787786422.390323:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237b53840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7644:1874629686785792:192.168.204.34@tcp:104: 00010000:00010000:0.0:1787786422.390358:0:7644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff26b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786422.396150:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786422.396252:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667890688 00000100:00100000:0.0:1787786422.396261:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667890688 00010000:00010000:0.0:1787786422.396316:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2665 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522de expref: 14 pid: 7644 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786422.396359:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 45 00000100:00100000:0.0:1787786422.396377:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b9503c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:173d08e0-0e54-474e-858e-1679cd38cf14+14:2365:x1874629667890688:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787786422.396393:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787786422.396400:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2665 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522de expref: 14 pid: 7644 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.396425:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2665 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522de expref: 14 pid: 7644 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.396574:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2665 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522de expref: 14 pid: 7644 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.396591:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8b5204e6f200) 00010000:00010000:0.0:1787786422.396596:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff26b2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.396605:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff26b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.396613:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff26b2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.396738:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787786422.396819:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b9503c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:173d08e0-0e54-474e-858e-1679cd38cf14+13:2365:x1874629667890688:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 442us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786422.396828:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 45 00010000:00010000:1.0:1787786422.396969:0:7644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff26b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.396978:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff26b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787786422.397208:0:7644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1787786422.397724:0:7644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1787786422.397779:0:7644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1787786422.398578:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b951e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7644:1874629686785920:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787786422.398643:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786422.398909:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5203e75240 going to sleep for 11 seconds 00000100:00100000:2.0:1787786422.399077:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686785920 00000100:00100000:2.0:1787786422.399086:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686785920 00000100:00100000:2.0:1787786422.399146:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787786422.399157:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b9512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7644:x1874629686785920:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787786422.399246:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b9512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7644:x1874629686785920:12345-0@lo:1000:mdt00_003.0 Request processed in 91us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786422.399255:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787786422.399534:0:7644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1787786422.399541:0:7644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b52063530c0, transno 4294967303 00000100:00100000:1.0:1787786422.399560:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b951e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7644:1874629686785920:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787786422.400320:0:7644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1787786422.400396:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b951e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7644:1874629686786048:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787786422.401376:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786422.401417:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5203e75f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787786422.401562:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686786048 00000100:00100000:2.0:1787786422.401570:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686786048 00000100:00100000:2.0:1787786422.401681:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787786422.401692:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b952d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7644:x1874629686786048:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787786422.401973:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b952d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7644:x1874629686786048:12345-0@lo:1000:mdt00_003.0 Request processed in 283us (599us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787786422.401982:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787786422.402081:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b951e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7644:1874629686786048:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787786422.402121:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff26b2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.402131:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff26b2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.402148:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff26b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.402155:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7600 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786422.402160:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff26b2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.402168:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff26b2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.402184:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8b5204e6f200) 00010000:00010000:1.0:1787786422.402187:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787786422.402192:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff26b2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.402198:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff26b2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.402234:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff25e0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.402241:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff25e0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.402247:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff25e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.402253:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d9a00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786422.402255:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff25e0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.402271:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff25e0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.402280:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b52100f1400) 00010000:00010000:1.0:1787786422.402282:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787786422.402298:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff25e0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.402303:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff25e0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.402325:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff26b9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.402339:0:7644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff25fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522c2 expref: 16 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.402348:0:7644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff26b9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.402376:0:7644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff25fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522c2 expref: 16 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.402390:0:7644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff25fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522c2 expref: 16 pid: 8713 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786422.402402:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b9530c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7644:1874629686786176:192.168.204.34@tcp:104: 00000100:00100000:1.0:1787786422.402481:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5203e75f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787786422.409161:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786422.409240:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667890816 00000100:00100000:2.0:1787786422.409250:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667890816 00000100:00100000:0.0:1787786422.409272:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b9530c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7644:1874629686786176:192.168.204.34@tcp:104: 00010000:00010000:2.0:1787786422.409305:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff25fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522c2 expref: 17 pid: 8713 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.409313:0:7644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff26b9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786422.409349:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 46 00000100:00100000:2.0:1787786422.409360:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b950780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+17:2365:x1874629667890816:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787786422.409373:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787786422.409380:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff25fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522c2 expref: 17 pid: 8713 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.409393:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff25fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522c2 expref: 17 pid: 8713 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.409413:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff25fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522c2 expref: 17 pid: 8713 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.409438:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b52100f1400) 00010000:00010000:2.0:1787786422.409443:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff26b9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.409452:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff26b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.409460:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff26b9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.409493:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787786422.409543:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b950780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+16:2365:x1874629667890816:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 185us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786422.409550:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 46 00010000:00010000:0.0:1787786422.409832:0:7644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff26b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.409841:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff26b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.409854:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff26b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.409860:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff26b9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.409867:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff26b9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.409875:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8600 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786422.409879:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff26b9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.409887:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff26b9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.409897:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b52100f1400) 00010000:00010000:0.0:1787786422.409900:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786422.409904:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff26b9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.409910:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff26b9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.409923:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff26ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.409936:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff26ab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.409942:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff26ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.409948:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb6200 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786422.409951:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff26ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.409958:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff26ab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.409966:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b52100f1400) 00010000:00010000:0.0:1787786422.409969:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787786422.409972:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff26ab lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.409978:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff26ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786422.410277:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bfdda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+15:10462:x1874629667890560:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 24885us (25076us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1787786422.410298:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 83 00000020:00080000:0.0:1787786422.410303:0:7644:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787786422.413213:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786422.413335:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667891072 00000100:00100000:3.0:1787786422.413345:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667891072 00000100:00100000:3.0:1787786422.413444:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 20 00000100:00100000:3.0:1787786422.413459:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b950b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+15:10462:x1874629667891072:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 00000040:00080000:2.0:1787786422.414065:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787786422.414070:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787786422.414121:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787786422.414128:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000004:00080000:3.0:1787786422.414255:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787786422.414388:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1787786422.414444:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff26c0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.414461:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff26c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.414472:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff26c0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.414480:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff26c0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.414487:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff26c0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.414504:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff26c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.414531:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787786422.414578:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787786422.414587:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff26c0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.414594:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7a00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:0.0:1787786422.414606:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff26c0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.414614:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff26c0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786422.414624:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b950b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+17:10462:x1874629667891072:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 Request processed in 1168us (1415us total) trans 4294967362 rc 0/0 00010000:00010000:0.0:1787786422.414627:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8b5204e6fc00) 00010000:00010000:0.0:1787786422.414633:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:3.0:1787786422.414637:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 20 00010000:00010000:0.0:1787786422.414638:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff26c0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1787786422.414643:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787786422.414647:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff26c0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.414664:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786422.414666:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786422.414668:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787786422.686672:0:12011:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787786422.686681:0:12011:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787786422.686714:0:12011:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787786422.686719:0:12011:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787786422.731444:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786422.794286:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787786422.794312:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237a352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686786304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787786422.794386:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786422.794495:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686786304 00000100:00100000:2.0:1787786422.794504:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686786304 00000100:00100000:2.0:1787786422.794556:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787786422.794566:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237b52940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874629686786304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787786422.794600:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787786422.794649:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237b52940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874629686786304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786422.794656:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787786422.795614:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237a352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686786304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787786422.801181:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786422.801247:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667891328 00000100:00100000:2.0:1787786422.801258:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667891328 00000100:00100000:2.0:1787786422.801330:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 84 00000100:00100000:2.0:1787786422.801341:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+17:10481:x1874629667891328:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:2.0:1787786422.801366:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786422.801387:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff26c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7522fa expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.801779:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff26ce lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.801825:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff26ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.802465:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff26ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786422.802492:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1787786422.802705:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff26c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522fa expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.802723:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff26ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522fa expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.802733:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b52100f1600) 00010000:00010000:2.0:1787786422.802736:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787786422.802740:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aad400, rc 0) 00000100:00100000:2.0:1787786422.802834:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+19:10481:x1874629667891328:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 1494us (1664us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1787786422.802853:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 84 00000100:00100000:0.0:1787786422.809866:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786422.810094:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667891456 00000100:00100000:3.0:1787786422.810106:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667891456 00000100:00100000:3.0:1787786422.810204:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 85 00000100:00100000:3.0:1787786422.810214:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+19:10481:x1874629667891456:12345-192.168.204.34@tcp:34:lfs.0 00010000:00010000:3.0:1787786422.810298:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff26dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.810315:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff26dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.810327:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff26dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.810342:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff26e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.810360:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff26e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.810366:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff26e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.815627:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff26ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.815647:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff26ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.815659:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff26ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787786422.815731:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff26ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.815746:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff26dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.815753:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff26dc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.815760:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff26dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.815766:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7a00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786422.815770:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff26dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.815777:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff26dc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.815825:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b52100f1600) 00010000:00010000:3.0:1787786422.815828:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786422.815832:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff26dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.815838:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff26dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.815857:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff26e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.815863:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff26e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.815867:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff26e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.815872:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb6200 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786422.815874:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff26e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.815880:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff26e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.815887:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b5204e6fb00) 00010000:00010000:3.0:1787786422.815889:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786422.815892:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff26e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.815897:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff26e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.815922:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff26ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.815928:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff26ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.815934:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff26ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.815940:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7600 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786422.815942:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff26ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.815948:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff26ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.815956:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b5204e6fe00) 00010000:00010000:3.0:1787786422.815958:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786422.815961:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff26ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.815967:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff26ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786422.816071:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+19:10481:x1874629667891456:12345-192.168.204.34@tcp:34:lfs.0 Request processed in 5853us (6210us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786422.816082:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 85 00000100:00100000:0.0:1787786422.882452:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786422.882494:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667891712 00000100:00100000:0.0:1787786422.882503:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667891712 00000100:00100000:0.0:1787786422.882552:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 86 00000100:00100000:0.0:1787786422.882562:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+19:10484:x1874629667891712:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1787786422.882581:0:7644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786422.882602:0:7644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff26f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752301 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.882677:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff26f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.882706:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff26f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.882718:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff26f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.882735:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff26ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.882742:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff26ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.882748:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff26ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.883354:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2706 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.883364:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2706 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.883371:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2706 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787786422.883380:0:7644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787786422.883475:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff26f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.883483:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff26f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.883489:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff26f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.883501:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912c200 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786422.883505:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff26f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.883513:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff26f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.883526:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b52100f1600) 00010000:00010000:0.0:1787786422.883529:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786422.883533:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff26f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.883539:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff26f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.883551:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff26ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.883557:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff26ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.883562:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff26ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.883568:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912da00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786422.883571:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff26ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.883577:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff26ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.883595:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b5222ae8600) 00010000:00010000:0.0:1787786422.883597:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786422.883599:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff26ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.883604:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff26ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.883651:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff26f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752301 expref: 22 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.883664:0:7644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2706 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752301 expref: 21 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.883671:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b5222ae8d00) 00010000:00010000:0.0:1787786422.883673:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787786422.883676:0:7644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912c000, rc 0) 00000100:00100000:0.0:1787786422.883745:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+21:10484:x1874629667891712:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 1185us (1302us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1787786422.883753:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 86 00000100:00100000:0.0:1787786422.900961:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786422.901318:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667891840 00000100:00100000:2.0:1787786422.901329:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667891840 00000100:00100000:2.0:1787786422.901392:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 87 00000100:00100000:2.0:1787786422.901403:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+21:10484:x1874629667891840:12345-192.168.204.34@tcp:54:lfs.0 00010000:00010000:2.0:1787786422.901470:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2714 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.901486:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.901517:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.901551:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.901558:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2714 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.901565:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2714 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.901572:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aac400 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786422.901576:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2714 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.901583:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2714 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.901595:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b5222ae8d00) 00010000:00010000:2.0:1787786422.901598:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787786422.901603:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2714 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.901609:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2714 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786422.901690:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+21:10484:x1874629667891840:12345-192.168.204.34@tcp:54:lfs.0 Request processed in 289us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786422.901697:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 87 00000100:00100000:3.0:1787786422.913409:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786422.913444:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667892096 00000100:00100000:3.0:1787786422.913452:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667892096 00000100:00100000:3.0:1787786422.913508:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 21 00000100:00100000:3.0:1787786422.913517:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52062ffc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+21:10484:x1874629667892096:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:3.0:1787786422.913751:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52062ffc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+22:10484:x1874629667892096:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 234us (351us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1787786422.913759:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 21 00000100:00100000:2.0:1787786422.964320:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786422.964405:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667892352 00000100:00100000:3.0:1787786422.964415:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667892352 00000100:00100000:3.0:1787786422.964473:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 88 00000100:00100000:3.0:1787786422.964483:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+22:10010:x1874629667892352:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:3.0:1787786422.964510:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786422.964530:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff271b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752308 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.964634:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2722 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.964648:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2706 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752301 expref: 23 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.964657:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2722 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.964691:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2706 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752301 expref: 23 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786422.964705:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2706 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752301 expref: 23 pid: 7644 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786422.964732:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237b51a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874629686786432:192.168.204.34@tcp:104: 00000100:00100000:3.0:1787786422.964855:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5213472780 going to sleep for 11 seconds 00000100:00100000:3.0:1787786422.971673:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786422.972813:0:8508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667892480 00000100:00100000:2.0:1787786422.972826:0:8508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667892480 00010000:00010000:2.0:1787786422.972879:0:8508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2706 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752301 expref: 24 pid: 7644 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786422.972925:0:8508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 47 00000100:00100000:2.0:1787786422.972936:0:8508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237b50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:173d08e0-0e54-474e-858e-1679cd38cf14+24:2364:x1874629667892480:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787786422.972952:0:8508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787786422.972958:0:8508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2706 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752301 expref: 24 pid: 7644 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.972972:0:8508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2706 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752301 expref: 24 pid: 7644 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.972998:0:8508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b5222ae8d00) 00010000:00010000:2.0:1787786422.973004:0:8508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2722 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.973014:0:8508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2722 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.973022:0:8508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2722 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786422.973041:0:8508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787786422.973110:0:8508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237b50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:173d08e0-0e54-474e-858e-1679cd38cf14+24:2364:x1874629667892480:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 175us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786422.973118:0:8508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 47 00010000:00010000:1.0:1787786422.973141:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2706 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752301 expref: 23 pid: 7644 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786422.973167:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237b51a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874629686786432:192.168.204.34@tcp:104: 00010000:00010000:1.0:1787786422.973190:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2722 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.973537:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2722 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.973547:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2722 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787786422.973567:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787786422.973752:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff271b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752308 expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.973770:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2722 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752308 expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.973779:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b5222ae8d00) 00010000:00010000:0.0:1787786422.973782:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787786422.973785:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb6200, rc 0) 00000100:00100000:0.0:1787786422.974066:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+23:10010:x1874629667892352:12345-192.168.204.34@tcp:101:bash.0 Request processed in 9581us (9754us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1787786422.974075:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 88 00000100:00100000:3.0:1787786422.978967:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786422.979232:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667892736 00000100:00100000:0.0:1787786422.979244:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667892736 00000100:00100000:0.0:1787786422.979321:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 89 00000100:00100000:0.0:1787786422.979332:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237b51a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+23:10010:x1874629667892736:12345-192.168.204.34@tcp:36:bash.0 00010000:00010000:0.0:1787786422.979645:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2730 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.979824:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2730 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.979840:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2730 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787786422.979926:0:8713:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1787786422.979955:0:8713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d3a4e2cb reply state 00000000dc238647 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2730 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786422.979964:0:8713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1787786422.980027:0:8713:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1787786422.980152:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237b51a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+27:10010:x1874629667892736:12345-192.168.204.34@tcp:36:bash.0 Request processed in 819us (1192us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1787786422.980162:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 89 00000020:00080000:0.0:1787786422.980169:0:8713:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1787786422.982475:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2730 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.982493:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2730 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.982502:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2730 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.982508:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912da00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786422.982513:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2730 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.982521:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2730 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.982538:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b5222ae8d00) 00010000:00010000:0.0:1787786422.982540:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786422.982546:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2730 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.982552:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2730 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786422.983106:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786422.983336:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667892864 00000100:00100000:0.0:1787786422.983346:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667892864 00000100:00100000:0.0:1787786422.983437:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 90 00000100:00100000:0.0:1787786422.983449:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237b52d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+26:10010:x1874629667892864:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:0.0:1787786422.983487:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786422.983507:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff2737 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75230f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.983568:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff2737 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75230f expref: 27 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.983583:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff2737 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75230f expref: 27 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786422.983602:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b5222ae8d00) 00010000:00010000:0.0:1787786422.983606:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787786422.983608:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912c200, rc 0) 00000100:00100000:0.0:1787786422.983711:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237b52d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+27:10010:x1874629667892864:12345-192.168.204.34@tcp:101:bash.0 Request processed in 264us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786422.983718:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 90 00000100:00100000:2.0:1787786422.986609:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786422.986720:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667892992 00000100:00100000:1.0:1787786422.986731:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667892992 00000100:00100000:1.0:1787786422.986808:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 33 00000100:00100000:1.0:1787786422.986819:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a35a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+6:10010:x1874629667892992:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:1.0:1787786422.986836:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786422.986857:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7c0f557/0x450132973bff273e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752316 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787786422.986885:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8f74b5, atime: 0x6a8f74b4, ctime: 0x6a8f74b5, blocks: 0xb 00010000:00010000:1.0:1787786422.986906:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=349s v=(0 0) 00010000:00010000:1.0:1787786422.986910:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786422.986918:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7c0f557/0x450132973bff273e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752316 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.986937:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b7c0f557/0x450132973bff273e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752316 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786422.986958:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523b4d8e00, rc 0) 00000100:00100000:1.0:1787786422.987068:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a35a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+7:10010:x1874629667892992:12345-192.168.204.34@tcp:101:bash.0 Request processed in 251us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786422.987076:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 33 00000100:00100000:1.0:1787786422.992559:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786422.992710:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667893120 00000100:00100000:3.0:1787786422.992723:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667893120 00002000:00010000:3.0:1787786422.992814:0:6704:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1787786422.992819:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8b523b950f00 with x1874629667893120 ext(0->18446744073709551615) 00002000:00010000:3.0:1787786422.992831:0:6704:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b523b950f00. 00000100:00100000:3.0:1787786422.992860:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 1 00000100:00100000:3.0:1787786422.992870:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b950f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:173d08e0-0e54-474e-858e-1679cd38cf14+7:2362:x1874629667893120:12345-192.168.204.34@tcp:10:bash.0 00002000:00010000:3.0:1787786422.994123:0:6704:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1787786422.994130:0:6704:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1787786421 -> 1787786423 00002000:00010000:3.0:1787786422.994133:0:6704:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1787786420 -> 1787786420 00002000:00010000:3.0:1787786422.994135:0:6704:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1787786421 -> 1787786423 00002000:00010000:3.0:1787786422.994138:0:6704:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1787786422.994348:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b950f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:173d08e0-0e54-474e-858e-1679cd38cf14+8:2362:x1874629667893120:12345-192.168.204.34@tcp:10:bash.0 Request processed in 1476us (1797us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787786422.994784:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 1 00002000:00010000:3.0:1787786422.994808:0:6704:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1787786422.994812:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8b523b950f00 with x1874629667893120 ext(0->18446744073709551615) 00002000:00010000:3.0:1787786422.994820:0:6704:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b523b950f00. 00000100:00100000:3.0:1787786423.080378:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786423.080564:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667893248 00000100:00100000:2.0:1787786423.080574:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667893248 00000100:00100000:2.0:1787786423.080663:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 91 00000100:00100000:2.0:1787786423.080673:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237b53c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+27:10498:x1874629667893248:12345-192.168.204.34@tcp:34:lfs.0 00000100:00080000:0.0:1787786423.080829:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787786423.081074:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2745 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.081093:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2745 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.081105:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2745 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.081122:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff274c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.081130:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff274c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.081136:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff274c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.083427:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff2753 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.083447:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff2753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.083459:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff2753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787786423.083626:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff2753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.083640:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2745 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.083647:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2745 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.083654:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2745 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.083661:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aac600 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786423.083665:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2745 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.083672:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2745 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.083685:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b52100f1600) 00010000:00010000:3.0:1787786423.083688:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786423.083692:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2745 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.083699:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2745 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.084642:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff274c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.084655:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff274c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.084662:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff274c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.084668:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aadc00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786423.084671:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff274c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.084679:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff274c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.084691:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b5210c81600) 00010000:00010000:3.0:1787786423.084693:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786423.084697:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff274c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.084704:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff274c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.084735:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff2753 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.084742:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff2753 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.084749:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff2753 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.084763:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7a00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786423.084767:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff2753 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.084773:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff2753 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.084782:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b5222ae8d00) 00010000:00010000:3.0:1787786423.084785:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786423.084804:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff2753 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.084812:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff2753 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786423.084926:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237b53c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+27:10498:x1874629667893248:12345-192.168.204.34@tcp:34:lfs.0 Request processed in 4249us (4552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786423.084944:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 91 00000100:00100000:0.0:1787786423.132409:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786423.134217:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667893504 00000100:00100000:2.0:1787786423.134234:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667893504 00000100:00100000:2.0:1787786423.134328:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 92 00000100:00100000:2.0:1787786423.134339:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+27:10501:x1874629667893504:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:2.0:1787786423.134363:0:8713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786423.134388:0:8713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff275a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75231d expref: -99 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.134470:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2761 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.134501:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2761 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.134513:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2761 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.134530:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2768 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.134537:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.134543:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.137709:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff276f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.137731:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff276f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.137745:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff276f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786423.137893:0:8713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787786423.137989:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2761 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.137997:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2761 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.138004:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2761 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.138018:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aac600 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786423.138023:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2761 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.138031:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2761 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.138046:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b52100f1600) 00010000:00010000:2.0:1787786423.138049:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786423.138054:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2761 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.138060:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2761 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.138073:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2768 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.138080:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2768 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.138086:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2768 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.138092:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aac000 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786423.138094:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2768 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.138101:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2768 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.138119:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b5210c81400) 00010000:00010000:2.0:1787786423.138121:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786423.138125:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2768 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.138131:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2768 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.138180:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff275a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75231d expref: 30 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.138195:0:8713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff276f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75231d expref: 29 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.138203:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b5222ae8d00) 00010000:00010000:2.0:1787786423.138206:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787786423.138208:0:8713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aac200, rc 0) 00000100:00100000:2.0:1787786423.138307:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+29:10501:x1874629667893504:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 3969us (5917us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1787786423.138321:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 92 00000100:00100000:2.0:1787786423.145103:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786423.148312:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667893632 00000100:00100000:0.0:1787786423.148327:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667893632 00000100:00100000:0.0:1787786423.148582:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 93 00000100:00100000:0.0:1787786423.148594:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a37840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+29:10501:x1874629667893632:12345-192.168.204.34@tcp:54:lfs.0 00010000:00010000:0.0:1787786423.148685:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff277d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.148705:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2722 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752308 expref: 29 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.148735:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff277d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.148786:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2722 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752308 expref: 29 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.148824:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2722 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752308 expref: 29 pid: 5847 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786423.148841:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bf85a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874629686786560:192.168.204.34@tcp:104: 00000100:00100000:0.0:1787786423.148955:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5210e6ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787786423.152359:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786423.152476:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bf85a40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874629686786560:192.168.204.34@tcp:104: 00010000:00010000:1.0:1787786423.152504:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff277d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786423.152571:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667893888 00000100:00100000:3.0:1787786423.152578:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667893888 00000100:00100000:3.0:1787786423.152647:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 22 00000100:00100000:3.0:1787786423.152656:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+30:5618:x1874629667893888:12345-192.168.204.34@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787786423.153417:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+31:5618:x1874629667893888:12345-192.168.204.34@tcp:35:ldlm_bl.0 Request processed in 759us (1067us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1787786423.153426:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 22 00000100:00100000:2.0:1787786423.156299:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786423.156392:0:11675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667894016 00000100:00100000:3.0:1787786423.156403:0:11675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667894016 00010000:00010000:3.0:1787786423.156442:0:11675:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2722 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752308 expref: 31 pid: 5847 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786423.156500:0:11675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 48 00000100:00100000:3.0:1787786423.156510:0:11675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a352c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:173d08e0-0e54-474e-858e-1679cd38cf14+31:2364:x1874629667894016:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787786423.156526:0:11675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786423.156534:0:11675:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2722 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752308 expref: 31 pid: 5847 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.156547:0:11675:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2722 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752308 expref: 31 pid: 5847 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.156571:0:11675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2722 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752308 expref: 31 pid: 5847 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.156587:0:11675:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b5222ae8d00) 00010000:00010000:3.0:1787786423.156592:0:11675:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff277d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.156601:0:11675:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff277d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.156610:0:11675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff277d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.156650:0:11675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787786423.156709:0:11675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a352c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:173d08e0-0e54-474e-858e-1679cd38cf14+30:2364:x1874629667894016:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 200us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786423.156717:0:11675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 48 00010000:00010000:1.0:1787786423.156823:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff277d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.156833:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff277d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.156869:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff277d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.156877:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff277d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.156884:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff277d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.156889:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912da00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786423.156894:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff277d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.156912:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff277d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.156922:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b5222ae8d00) 00010000:00010000:1.0:1787786423.156925:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787786423.156929:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff277d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.156945:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff277d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786423.156985:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a37840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+29:10501:x1874629667893632:12345-192.168.204.34@tcp:54:lfs.0 Request processed in 8394us (11893us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786423.156993:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 93 00000100:00100000:2.0:1787786423.160697:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786423.160818:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667894272 00000100:00100000:3.0:1787786423.160841:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667894272 00000100:00100000:3.0:1787786423.160889:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 23 00000100:00100000:3.0:1787786423.160898:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523298a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+29:10501:x1874629667894272:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:3.0:1787786423.161155:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523298a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+30:10501:x1874629667894272:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 258us (468us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1787786423.161164:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 23 00000100:00100000:0.0:1787786423.237470:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786423.237630:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667894528 00000100:00100000:3.0:1787786423.237642:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667894528 00000100:00100000:3.0:1787786423.237702:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 94 00000100:00100000:3.0:1787786423.237826:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+30:10512:x1874629667894528:12345-192.168.204.34@tcp:101:cat.0 00010000:00010000:3.0:1787786423.237854:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786423.237887:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2784 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752324 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.238193:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff278b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.238530:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff278b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.238545:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff278b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.238564:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff2792 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.238572:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff2792 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.238578:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff2792 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.240697:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff2799 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.240724:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff2799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.240733:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff2799 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786423.240743:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1787786423.240852:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff278b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.240857:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff278b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.240862:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff278b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.240866:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7a00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786423.240869:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff278b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.240875:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff278b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.240885:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b52100f1600) 00010000:00010000:3.0:1787786423.240887:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786423.240890:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff278b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.240902:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff278b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.240913:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff2792 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.240916:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff2792 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.240919:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff2792 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.240923:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb6800 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786423.240924:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff2792 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.240927:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff2792 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.240931:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b5204e6fe00) 00010000:00010000:3.0:1787786423.240933:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786423.240934:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff2792 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.240937:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff2792 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.240994:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2784 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752324 expref: 33 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.241009:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff2799 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752324 expref: 32 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.241023:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b5222ae8d00) 00010000:00010000:3.0:1787786423.241026:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787786423.241029:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb6a00, rc 0) 00000100:00100000:3.0:1787786423.241119:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+32:10512:x1874629667894528:12345-192.168.204.34@tcp:101:cat.0 Request processed in 3334us (3659us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1787786423.241128:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 94 00000100:00100000:2.0:1787786423.248428:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786423.251735:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667894784 00000100:00100000:3.0:1787786423.251752:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667894784 00000100:00100000:3.0:1787786423.253633:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 24 00000100:00100000:3.0:1787786423.253652:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52088b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+32:10512:x1874629667894784:12345-192.168.204.34@tcp:35:cat.0 00000100:00100000:3.0:1787786423.253932:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52088b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+33:10512:x1874629667894784:12345-192.168.204.34@tcp:35:cat.0 Request processed in 287us (5514us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1787786423.253940:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 24 00000100:00100000:2.0:1787786423.280123:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786423.280325:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667895040 00000100:00100000:0.0:1787786423.280337:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667895040 00000100:00100000:0.0:1787786423.280401:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 95 00000100:00100000:0.0:1787786423.280412:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52088b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+33:10513:x1874629667895040:12345-192.168.204.34@tcp:36:rm.0 00010000:00010000:0.0:1787786423.280477:0:8713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787786423.280512:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff2799 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752324 expref: 33 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.280538:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff276f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75231d expref: 32 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.280552:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff2737 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75230f expref: 31 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.280579:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b5222ae8d00) 00010000:00010000:0.0:1787786423.280591:0:8713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787786423.280614:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff27a7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.280629:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff27a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.280640:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff27a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.280656:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff27ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.280663:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff27ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.280670:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff27ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.282153:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff27b5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.282172:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff27b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.282182:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff27b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787786423.282839:0:8713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1787786423.282850:0:8713:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 349641058891ns, next at 350641056286ns, rc = 0 00010000:00010000:0.0:1787786423.282922:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff27bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.283336:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff27bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.283349:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff27bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.283356:0:8713:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff27bc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.283363:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff27bc lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.283370:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff27bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.283398:0:8713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787786423.283422:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff27b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.283429:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff27b5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.283436:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff27b5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.283443:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912da00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786423.283448:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff27b5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.283458:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff27b5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.283478:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b5222ae8400) 00010000:00010000:0.0:1787786423.283481:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787786423.283485:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff27b5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.283492:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff27b5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.283510:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff27a7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.283516:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff27a7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.283522:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff27a7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.283526:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912ce00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786423.283529:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff27a7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.283535:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff27a7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.283543:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b52100f1600) 00010000:00010000:0.0:1787786423.283545:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786423.283548:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff27a7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.283554:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff27a7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787786423.283576:0:8713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000032340ced reply state 00000000d4f91569 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff27ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786423.283586:0:8713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787786423.283684:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52088b7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+32:10513:x1874629667895040:12345-192.168.204.34@tcp:36:rm.0 Request processed in 3270us (3568us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1787786423.283693:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 95 00010000:00010000:1.0:1787786423.284624:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787786423.284633:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff27bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.284641:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912dc00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:1.0:1787786423.284645:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff27bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.284652:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff27bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.284664:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8b5222ae8400) 00010000:00010000:1.0:1787786423.284667:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787786423.284670:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff27bc lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.284690:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff27bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.284710:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786423.284712:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786423.284713:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786423.289361:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff27ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.289379:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff27ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.289608:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff27ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.289616:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912d400 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786423.289622:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff27ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.289631:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff27ae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.289648:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b5222ae8600) 00010000:00010000:0.0:1787786423.289651:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786423.289656:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff27ae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.289663:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff27ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786423.334365:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786423.334418:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667895296 00000100:00100000:1.0:1787786423.334428:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667895296 00000100:00100000:0.0:1787786423.334504:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 96 00000100:00100000:0.0:1787786423.334518:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52088b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+31:10519:x1874629667895296:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:0.0:1787786423.334544:0:7644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786423.334566:0:7644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff27c3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75232b expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.334698:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff27ca lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.334713:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff27ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.334725:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff27ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.334740:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff27d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.334746:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff27d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.334752:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff27d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787786423.335632:0:7644:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1787786423.336362:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff27d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.336381:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff27d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.336403:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff27d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.336440:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff27ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.336449:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff27ca lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.336456:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff27ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.336463:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912ce00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786423.336467:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff27ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.336475:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff27ca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.336488:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b52100f1600) 00010000:00010000:0.0:1787786423.336491:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786423.336496:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff27ca lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.336502:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff27ca lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787786423.336515:0:7644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070d594fa reply state 00000000bbd646dd transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff27d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786423.336523:0:7644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787786423.336562:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff27c3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75232b expref: 34 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.336577:0:7644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff27d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75232b expref: 33 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.336584:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5222ae8d00) 00010000:00010000:0.0:1787786423.336587:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787786423.336589:0:7644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912c200, rc 0) 00000100:00100000:0.0:1787786423.336672:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52088b6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+34:10519:x1874629667895296:12345-192.168.204.34@tcp:101:bash.0 Request processed in 2159us (2317us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1787786423.336681:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 96 00010000:00010000:0.0:1787786423.343353:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff27d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.343372:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff27d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.343381:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff27d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.343388:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912da00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786423.343393:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff27d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.343401:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff27d1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.343419:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b5222ae8600) 00010000:00010000:0.0:1787786423.343423:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786423.343444:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff27d1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.343456:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff27d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786423.347644:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786423.348279:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667895424 00000100:00100000:1.0:1787786423.348290:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667895424 00000100:00100000:1.0:1787786423.348371:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 34 00000100:00100000:1.0:1787786423.348382:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52088b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:173d08e0-0e54-474e-858e-1679cd38cf14+7:2365:x1874629667895424:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:1.0:1787786423.348404:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786423.348427:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee6abb1b/0x450132973bff27e6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752332 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787786423.348464:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787786423.348484:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=349s v=(0 0) 00010000:00010000:1.0:1787786423.348489:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786423.348500:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee6abb1b/0x450132973bff27e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752332 expref: 8 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.348521:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ee6abb1b/0x450132973bff27e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752332 expref: 8 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.348535:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523b4d8600, rc 0) 00000100:00100000:1.0:1787786423.348599:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52088b5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:173d08e0-0e54-474e-858e-1679cd38cf14+8:2365:x1874629667895424:12345-192.168.204.34@tcp:101:bash.0 Request processed in 218us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786423.348614:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 34 00000100:00080000:0.0:1787786423.349053:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787786423.353676:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786423.353972:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667895552 00000100:00100000:3.0:1787786423.353983:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667895552 00000100:00100000:3.0:1787786423.354132:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 35 00000100:00100000:3.0:1787786423.354144:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b952580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+8:10519:x1874629667895552:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:3.0:1787786423.354175:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786423.354194:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bfb33a7/0x450132973bff27ed lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752339 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.354227:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee6abb1b/0x450132973bff27e6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752332 expref: 9 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.354256:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787786423.354260:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787786423.354277:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bfb33a7/0x450132973bff27ed lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752339 expref: 9 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.354314:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ee6abb1b/0x450132973bff27e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752332 expref: 9 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.354330:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ee6abb1b/0x450132973bff27e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752332 expref: 9 pid: 6700 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786423.354344:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237b53840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6699:1874629686786688:192.168.204.34@tcp:104: 00000100:00100000:3.0:1787786423.354449:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5237b019c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787786423.359653:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237b53840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6699:1874629686786688:192.168.204.34@tcp:104: 00010000:00010000:3.0:1787786423.359698:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000bfb33a7/0x450132973bff27ed lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752339 expref: 9 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.359723:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb6200, rc 0) 00000100:00100000:3.0:1787786423.359825:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b952580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+9:10519:x1874629667895552:12345-192.168.204.34@tcp:101:bash.0 Request processed in 5683us (6157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786423.359834:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 35 00000100:00100000:2.0:1787786423.360046:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786423.360458:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667895680 00000100:00100000:3.0:1787786423.360466:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667895680 00010000:00010000:3.0:1787786423.360499:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee6abb1b/0x450132973bff27e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752332 expref: 9 pid: 6700 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786423.361605:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 49 00000100:00100000:3.0:1787786423.361633:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5211bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:173d08e0-0e54-474e-858e-1679cd38cf14+9:2364:x1874629667895680:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787786423.361653:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786423.361683:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ee6abb1b/0x450132973bff27e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752332 expref: 9 pid: 6700 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.361701:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ee6abb1b/0x450132973bff27e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752332 expref: 9 pid: 6700 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.361729:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee6abb1b/0x450132973bff27e6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752332 expref: 9 pid: 6700 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.361748:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787786423.361753:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787786423.361761:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000bfb33a7/0x450132973bff27ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752339 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.361772:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bfb33a7/0x450132973bff27ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752339 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.361852:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000bfb33a7/0x450132973bff27ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752339 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786423.361869:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237b53840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5832:1874629686786816:192.168.204.34@tcp:105: 00000100:00100000:3.0:1787786423.361973:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5237b019c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787786423.367571:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786423.367668:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667895936 00000100:00100000:0.0:1787786423.367677:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667895936 00000100:00100000:0.0:1787786423.367741:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 25 00000100:00100000:0.0:1787786423.367752:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52088b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+33:10519:x1874629667895936:12345-192.168.204.34@tcp:35:bash.0 00000100:00100000:0.0:1787786423.368324:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52088b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+34:10519:x1874629667895936:12345-192.168.204.34@tcp:35:bash.0 Request processed in 571us (761us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1787786423.368332:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 25 00000100:00100000:3.0:1787786423.368501:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237b53840 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5832:1874629686786816:192.168.204.34@tcp:105: 00010000:00010000:3.0:1787786423.368527:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787786423.368557:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5211bf8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:173d08e0-0e54-474e-858e-1679cd38cf14+8:2364:x1874629667895680:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 6942us (8512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786423.368565:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 49 00000100:00100000:2.0:1787786423.508891:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786423.510036:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667896064 00000100:00100000:3.0:1787786423.510050:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667896064 00000100:00100000:3.0:1787786423.510165:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 97 00000100:00100000:3.0:1787786423.510187:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52088b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+34:10535:x1874629667896064:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:3.0:1787786423.510221:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786423.510243:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff27f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752340 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.510322:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff27fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.510338:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff27fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.510351:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff27fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786423.510424:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787786423.510429:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787786423.510454:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff27fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.510481:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff27f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752340 expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.510517:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff27fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752340 expref: 35 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.510526:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b52100f1600) 00010000:00010000:3.0:1787786423.510529:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787786423.510532:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb7a00, rc 0) 00000100:00100000:3.0:1787786423.510606:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52088b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+35:10535:x1874629667896064:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 421us (1725us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786423.510614:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 97 00000100:00100000:2.0:1787786423.520711:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786423.520831:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667896320 00000100:00100000:0.0:1787786423.520841:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667896320 00000100:00100000:0.0:1787786423.520909:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 98 00000100:00100000:0.0:1787786423.520921:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52088b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+35:10535:x1874629667896320:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1787786423.520942:0:8713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786423.520965:0:8713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff2802 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752347 expref: -99 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.521074:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2809 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.521089:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.521102:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787786423.521136:0:8713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787786423.521638:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff2802 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752347 expref: 38 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.521660:0:8713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2809 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752347 expref: 37 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.521669:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5222ae8d00) 00010000:00010000:0.0:1787786423.521671:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787786423.521675:0:8713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912ce00, rc 0) 00000100:00100000:0.0:1787786423.521835:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52088b43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+37:10535:x1874629667896320:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 827us (1045us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1787786423.521845:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 98 00000100:00100000:1.0:1787786423.527502:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786423.529130:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667896576 00000100:00100000:0.0:1787786423.529144:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667896576 00000100:00100000:0.0:1787786423.529492:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 99 00000100:00100000:0.0:1787786423.529504:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b951680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+37:10535:x1874629667896576:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1787786423.529533:0:7644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786423.529557:0:7644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d600/0x450132973bff2817 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75234e expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.529657:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff281e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.529672:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff281e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.529701:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff281e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787786423.529715:0:7644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787786423.529878:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d600/0x450132973bff2817 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75234e expref: 40 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.529898:0:7644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff281e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75234e expref: 39 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.529907:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5222ae8d00) 00010000:00010000:0.0:1787786423.529911:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787786423.529914:0:7644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912c000, rc 0) 00000100:00100000:0.0:1787786423.530252:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b951680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+39:10535:x1874629667896576:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 749us (2761us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1787786423.530260:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 99 00000100:00100000:2.0:1787786423.531930:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786423.532032:0:8508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667896704 00000100:00100000:3.0:1787786423.532041:0:8508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667896704 00000100:00100000:3.0:1787786423.532104:0:8508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 6 00000100:00100000:3.0:1787786423.532115:0:8508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52088b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:173d08e0-0e54-474e-858e-1679cd38cf14+39:2363:x1874629667896704:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787786423.532131:0:8508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786423.532157:0:8508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2809 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752347 expref: 39 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.532175:0:8508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5222ae8d00) 00010000:00010000:3.0:1787786423.532190:0:8508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787786423.532259:0:8508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52088b5e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:173d08e0-0e54-474e-858e-1679cd38cf14+38:2363:x1874629667896704:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 133us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786423.532278:0:8508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 6 00000100:00100000:2.0:1787786423.543958:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786423.544081:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667896832 00000100:00100000:3.0:1787786423.544091:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667896832 00000100:00100000:3.0:1787786423.544154:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 36 00000100:00100000:3.0:1787786423.544165:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52088b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+8:2365:x1874629667896832:12345-192.168.204.34@tcp:1:lfs.0 00010000:00010000:3.0:1787786423.544521:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbd8bf80/0x450132973bff282c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.544547:0:8126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000bfb33a7/0x450132973bff27ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752339 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.544556:0:8126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787786423.544560:0:8126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787786423.544564:0:8126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbd8bf80/0x450132973bff282c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.544604:0:8126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000bfb33a7/0x450132973bff27ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752339 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.545086:0:8126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000bfb33a7/0x450132973bff27ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752339 expref: 8 pid: 6699 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786423.545105:0:8126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237b52580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8126:1874629686786944:192.168.204.34@tcp:104: 00000100:00100000:2.0:1787786423.545989:0:8126:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5237b01a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787786423.549341:0:8126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237b52580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8126:1874629686786944:192.168.204.34@tcp:104: 00010000:00010000:2.0:1787786423.549376:0:8126:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fbd8bf80/0x450132973bff282c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786423.551435:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786423.551530:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667896960 00000100:00100000:3.0:1787786423.551541:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667896960 00002000:00100000:3.0:1787786423.551591:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8b52088b6d00 x1874629667896960/t0(0) o4->173d08e0-0e54-474e-858e-1679cd38cf14@192.168.204.34@tcp:39/0 lens 504/0 e 0 to 0 dl 1787786434 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787786423.551602:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8b52088b6d00 with x1874629667896960 ext(0->8) 00010000:00010000:3.0:1787786423.551611:0:6706:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000bfb33a7/0x450132973bff27ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752339 expref: 9 pid: 6699 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.551644:0:6706:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000bfb33a7/0x450132973bff27ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752339 expref: 9 pid: 6699 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787786423.551652:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8b52088b6d00 00000100:00100000:3.0:1787786423.551690:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 1 00000100:00100000:3.0:1787786423.551699:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52088b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:173d08e0-0e54-474e-858e-1679cd38cf14+9:2364:x1874629667896960:12345-192.168.204.34@tcp:4:lfs.0 00000100:00100000:3.0:1787786423.552171:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52088b6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:173d08e0-0e54-474e-858e-1679cd38cf14+11:2364:x1874629667896960:12345-192.168.204.34@tcp:4:lfs.0 Request processed in 470us (741us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787786423.552180:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 1 00002000:00100000:3.0:1787786423.552188:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8b52088b6d00 x1874629667896960/t4294967302(0) o4->173d08e0-0e54-474e-858e-1679cd38cf14@192.168.204.34@tcp:39/0 lens 504/448 e 0 to 0 dl 1787786434 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787786423.552196:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8b52088b6d00 with x1874629667896960 ext(0->8) 00010000:00010000:3.0:1787786423.552202:0:6706:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000000bfb33a7/0x450132973bff27ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752339 expref: 11 pid: 6699 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.552215:0:6706:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000000bfb33a7/0x450132973bff27ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752339 expref: 11 pid: 6699 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787786423.552222:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8b52088b6d00 00000100:00100000:0.0:1787786423.560071:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786423.560164:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667897088 00000100:00100000:2.0:1787786423.560174:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667897088 00010000:00010000:2.0:1787786423.560216:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000bfb33a7/0x450132973bff27ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752339 expref: 11 pid: 6699 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786423.560270:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 50 00000100:00100000:2.0:1787786423.560282:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52063530c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+11:2362:x1874629667897088:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787786423.560300:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787786423.560323:0:5833:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787786423.560326:0:5833:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787786423 00002000:00010000:2.0:1787786423.560329:0:5833:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787786423 00002000:00010000:2.0:1787786423.560441:0:5833:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787786423 00010000:00010000:2.0:1787786423.560449:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000bfb33a7/0x450132973bff27ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752339 expref: 11 pid: 6699 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.560487:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000bfb33a7/0x450132973bff27ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752339 expref: 11 pid: 6699 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.560511:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bfb33a7/0x450132973bff27ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752339 expref: 11 pid: 6699 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.560530:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787786423.560534:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787786423.560540:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fbd8bf80/0x450132973bff282c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.560550:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fbd8bf80/0x450132973bff282c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.560625:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787786423.560686:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52063530c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+10:2362:x1874629667897088:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 406us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786423.560695:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 50 00010000:00010000:3.0:1787786423.563744:0:8126:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fbd8bf80/0x450132973bff282c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.563771:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fbd8bf80/0x450132973bff282c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.563846:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fbd8bf80/0x450132973bff282c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.563859:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fbd8bf80/0x450132973bff282c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.563868:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fbd8bf80/0x450132973bff282c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.563876:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb6800 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:3.0:1787786423.563881:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbd8bf80/0x450132973bff282c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.563890:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fbd8bf80/0x450132973bff282c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.563911:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fbd8bf80/0x450132973bff282c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.563919:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fbd8bf80/0x450132973bff282c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786423.564007:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52088b52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+9:2365:x1874629667896832:12345-192.168.204.34@tcp:1:lfs.0 Request processed in 19840us (20057us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786423.564016:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 36 00000100:00100000:0.0:1787786423.567464:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786423.567535:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667897344 00000100:00100000:1.0:1787786423.567545:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667897344 00000100:00100000:1.0:1787786423.567605:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 26 00000100:00100000:1.0:1787786423.567616:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52062fc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+38:10535:x1874629667897344:12345-192.168.204.34@tcp:35:lfs.0 00000004:00010000:1.0:1787786423.567698:0:5850:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff281e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75234e expref: 38 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787786423.568030:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:1.0:1787786423.568083:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1787786423.568464:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:1.0:1787786423.568520:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2833 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.568536:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff27d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75232b expref: 42 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.568545:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2833 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.568583:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff27d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75232b expref: 42 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.568599:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff27d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75232b expref: 42 pid: 7644 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786423.568628:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b9521c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5850:1874629686787072:192.168.204.34@tcp:104: 00000100:00100000:1.0:1787786423.568722:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b520133a000 going to sleep for 11 seconds 00000100:00100000:1.0:1787786423.572578:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b9521c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5850:1874629686787072:192.168.204.34@tcp:104: 00010000:00010000:1.0:1787786423.572607:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2833 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786423.573296:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786423.573431:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667897472 00000100:00100000:3.0:1787786423.573440:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667897472 00010000:00010000:3.0:1787786423.573479:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff27d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75232b expref: 43 pid: 7644 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786423.573519:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 51 00000100:00100000:3.0:1787786423.573530:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:173d08e0-0e54-474e-858e-1679cd38cf14+43:2364:x1874629667897472:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787786423.573546:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786423.573553:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff27d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75232b expref: 43 pid: 7644 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.573565:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff27d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75232b expref: 43 pid: 7644 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.573587:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff27d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75232b expref: 43 pid: 7644 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.573602:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5222ae8d00) 00010000:00010000:3.0:1787786423.573607:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2833 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.573616:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2833 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.573624:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2833 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.573653:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787786423.573704:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:173d08e0-0e54-474e-858e-1679cd38cf14+42:2364:x1874629667897472:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 177us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786423.573725:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 51 00010000:00010000:1.0:1787786423.573785:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2833 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.573883:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2833 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787786423.574015:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1787786423.574230:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1787786423.574370:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b9521c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1874629686787200:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787786423.574419:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786423.574454:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b520133acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787786423.574552:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686787200 00000100:00100000:2.0:1787786423.574558:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686787200 00000100:00100000:2.0:1787786423.574595:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787786423.574604:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b953840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5850:x1874629686787200:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787786423.574670:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b953840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5850:x1874629686787200:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 68us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786423.574677:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787786423.574922:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b9521c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1874629686787200:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787786423.575690:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1787786423.575763:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b9521c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1874629686787328:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787786423.575829:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786423.575961:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b522cc5bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787786423.576024:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686787328 00000100:00100000:2.0:1787786423.576031:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686787328 00000100:00100000:2.0:1787786423.576070:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787786423.576079:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b953c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5850:x1874629686787328:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787786423.576465:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b953c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5850:x1874629686787328:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 387us (635us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787786423.576473:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787786423.576919:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b9521c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1874629686787328:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787786423.576988:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1787786423.577843:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2833 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.577871:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2833 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.577880:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2833 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.577886:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8a00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786423.577890:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2833 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.577898:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2833 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.577915:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5222ae8d00) 00010000:00010000:1.0:1787786423.577919:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787786423.577924:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2833 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.577931:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2833 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787786423.578193:0:5850:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787786423.578342:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1787786423.578354:0:5850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 349936563064ns, next at 350936560819ns, rc = 0 00000001:00080000:1.0:1787786423.578363:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1787786423.578411:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5222ae8d00) 00010000:00010000:1.0:1787786423.578414:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787786423.578424:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff281e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75234e expref: 46 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786423.578574:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52062fc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+45:10535:x1874629667897344:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 10959us (11119us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1787786423.578585:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 26 00000020:00080000:1.0:1787786423.578590:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787786423.584281:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786423.585365:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667897600 00000100:00100000:3.0:1787786423.585380:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667897600 00000100:00100000:2.0:1787786423.585753:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 100 00000100:00100000:2.0:1787786423.585767:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+45:10535:x1874629667897600:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:2.0:1787786423.585811:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786423.585839:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff283a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752355 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.585904:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff283a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752355 expref: 46 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.585920:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff283a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752355 expref: 46 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.585940:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5210c81400) 00010000:00010000:2.0:1787786423.585944:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787786423.585948:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aacc00, rc 0) 00000100:00100000:2.0:1787786423.587869:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+46:10535:x1874629667897600:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 2097us (3600us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786423.587882:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 100 00000100:00100000:2.0:1787786423.593909:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786423.594287:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667897856 00000100:00100000:0.0:1787786423.594297:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667897856 00000100:00100000:0.0:1787786423.594439:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 27 00000100:00100000:0.0:1787786423.594450:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52088b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+46:10535:x1874629667897856:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:0.0:1787786423.594705:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52088b70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+47:10535:x1874629667897856:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 256us (806us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1787786423.594730:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 27 00000100:00100000:1.0:1787786423.654256:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786423.654364:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667897984 00000100:00100000:0.0:1787786423.654375:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667897984 00000100:00100000:0.0:1787786423.654445:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 101 00000100:00100000:0.0:1787786423.654455:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b952940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+47:10545:x1874629667897984:12345-192.168.204.34@tcp:34:lfs.0 00010000:00010000:0.0:1787786423.654544:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff2841 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.654567:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff2841 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.654582:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff2841 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.654598:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2848 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.654606:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.654613:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.654724:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff284f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.654733:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff284f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.654741:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff284f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787786423.654852:0:8713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff284f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.654865:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff2841 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.654871:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff2841 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.654877:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff2841 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.654883:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912c200 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786423.654887:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff2841 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.654894:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff2841 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.654907:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b52100f1600) 00010000:00010000:0.0:1787786423.654910:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786423.654914:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff2841 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.654921:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff2841 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.654935:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.654943:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2848 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.655190:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2848 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.655197:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912c000 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786423.655200:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2848 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.655207:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2848 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.655216:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b5222ae8600) 00010000:00010000:0.0:1787786423.655219:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786423.655222:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2848 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.655228:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2848 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.655242:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff284f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.655248:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff284f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.655253:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff284f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.655258:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912d200 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786423.655272:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff284f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.655289:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff284f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.655297:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5210c81400) 00010000:00010000:0.0:1787786423.655300:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786423.655303:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff284f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.655406:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff284f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786423.656347:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b952940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+47:10545:x1874629667897984:12345-192.168.204.34@tcp:34:lfs.0 Request processed in 1886us (2096us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786423.656359:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 101 00000100:00100000:2.0:1787786423.702020:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786423.702274:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667898240 00000100:00100000:0.0:1787786423.702285:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667898240 00000100:00100000:0.0:1787786423.702349:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 102 00000100:00100000:0.0:1787786423.702359:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52088b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+47:10548:x1874629667898240:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1787786423.702380:0:7644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786423.702401:0:7644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff2856 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75235c expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.702475:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff285d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.702492:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff285d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.702504:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff285d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.702518:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff2864 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.702537:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff2864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.702543:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff2864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.702689:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff286b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.702698:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff286b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.702705:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff286b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787786423.702715:0:7644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787786423.702870:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff285d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.702877:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff285d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.702884:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff285d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.702890:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912c000 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786423.702894:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff285d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.702901:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff285d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.702925:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b52100f1600) 00010000:00010000:0.0:1787786423.702928:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786423.702934:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff285d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.702941:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff285d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.702954:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff2864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.702961:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff2864 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.702966:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff2864 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.702972:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912c200 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786423.702975:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff2864 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.702981:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff2864 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.702988:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b5222ae8600) 00010000:00010000:0.0:1787786423.702991:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786423.702994:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff2864 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.703000:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff2864 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.703302:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff2856 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75235c expref: 50 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.703319:0:7644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff286b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75235c expref: 49 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.703327:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5210c81400) 00010000:00010000:1.0:1787786423.703329:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787786423.703332:0:7644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912d400, rc 0) 00000100:00100000:1.0:1787786423.703400:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52088b4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+49:10548:x1874629667898240:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 1042us (1393us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1787786423.703408:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 102 00000100:00100000:2.0:1787786423.707520:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786423.707606:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667898368 00000100:00100000:3.0:1787786423.707616:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667898368 00000100:00100000:3.0:1787786423.707704:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 103 00000100:00100000:3.0:1787786423.707716:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52088b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+49:10548:x1874629667898368:12345-192.168.204.34@tcp:54:lfs.0 00010000:00010000:3.0:1787786423.707841:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff2879 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.707860:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff2879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.707872:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff2879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.707901:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff2879 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.707907:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff2879 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.707914:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff2879 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.707920:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb6800 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786423.707925:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff2879 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.707933:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff2879 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.707963:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5210c81400) 00010000:00010000:3.0:1787786423.707966:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787786423.707972:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff2879 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.707978:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff2879 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786423.708065:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52088b4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+49:10548:x1874629667898368:12345-192.168.204.34@tcp:54:lfs.0 Request processed in 351us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786423.708073:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 103 00000100:00100000:0.0:1787786423.712459:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786423.712505:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667898624 00000100:00100000:3.0:1787786423.712516:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667898624 00000100:00100000:3.0:1787786423.712575:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 28 00000100:00100000:3.0:1787786423.712585:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+49:10548:x1874629667898624:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:3.0:1787786423.713053:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+50:10548:x1874629667898624:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 468us (603us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1787786423.713062:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 28 00010000:00010000:0.0:1787786423.757610:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786423.787137:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786423.789706:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667898880 00000100:00100000:1.0:1787786423.789726:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667898880 00000100:00100000:1.0:1787786423.789821:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 104 00000100:00100000:1.0:1787786423.789831:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+50:10558:x1874629667898880:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:1.0:1787786423.789856:0:8713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786423.789872:0:8713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787786423.789902:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff27fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752340 expref: 50 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.790093:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b52100f1600) 00010000:00010000:1.0:1787786423.790101:0:8713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787786423.790124:0:8713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9000/0x450132973bff2880 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752363 expref: -99 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.790356:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff2887 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.790370:0:8713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff286b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75235c expref: 50 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.790495:0:8713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff2887 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.790626:0:8713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff286b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75235c expref: 50 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.790641:0:8713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff286b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75235c expref: 50 pid: 7644 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786423.790655:0:8713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b951a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8713:1874629686787456:192.168.204.34@tcp:104: 00000100:00100000:1.0:1787786423.790775:0:8713:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b522cc5bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787786423.795572:0:8713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b951a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8713:1874629686787456:192.168.204.34@tcp:104: 00010000:00010000:1.0:1787786423.795606:0:8713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff2887 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786423.795711:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786423.796702:0:11675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667899008 00000100:00100000:1.0:1787786423.796712:0:11675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667899008 00010000:00010000:1.0:1787786423.796761:0:11675:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff286b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75235c expref: 51 pid: 7644 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786423.796928:0:11675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 52 00000100:00100000:1.0:1787786423.796939:0:11675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:173d08e0-0e54-474e-858e-1679cd38cf14+51:2365:x1874629667899008:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787786423.796957:0:11675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786423.796964:0:11675:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff286b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75235c expref: 51 pid: 7644 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.796978:0:11675:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff286b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75235c expref: 51 pid: 7644 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.797000:0:11675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff286b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75235c expref: 51 pid: 7644 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.797016:0:11675:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5210c81400) 00010000:00010000:1.0:1787786423.797022:0:11675:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff2887 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.797032:0:11675:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff2887 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.797040:0:11675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff2887 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.797074:0:11675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787786423.797113:0:8713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff2887 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.797123:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff2887 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786423.797145:0:8713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00000100:00100000:1.0:1787786423.797170:0:11675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:173d08e0-0e54-474e-858e-1679cd38cf14+50:2365:x1874629667899008:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 231us (1458us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786423.797178:0:11675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 52 00010000:00010000:2.0:1787786423.797318:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9000/0x450132973bff2880 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752363 expref: 51 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.797333:0:8713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff2887 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752363 expref: 50 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.797341:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5210c81400) 00010000:00010000:2.0:1787786423.797344:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787786423.797347:0:8713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523b4d9c00, rc 0) 00000100:00100000:2.0:1787786423.797374:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+50:10558:x1874629667898880:12345-192.168.204.34@tcp:101:bash.0 Request processed in 7544us (10248us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1787786423.797381:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 104 00000100:00100000:2.0:1787786423.802627:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786423.802740:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667899264 00000100:00100000:1.0:1787786423.802752:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667899264 00000100:00100000:2.0:1787786423.802856:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 105 00000100:00100000:2.0:1787786423.802868:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52088b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+50:10558:x1874629667899264:12345-192.168.204.34@tcp:36:bash.0 00010000:00010000:2.0:1787786423.803308:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2895 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.803327:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2895 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.803621:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2895 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787786423.803685:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1787786423.803712:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000040dd1c0e reply state 000000007dd80b79 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2895 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786423.803721:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787786423.803857:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52088b4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+53:10558:x1874629667899264:12345-192.168.204.34@tcp:36:bash.0 Request processed in 991us (1240us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1787786423.803866:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 105 00000020:00080000:2.0:1787786423.803872:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787786423.808187:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2895 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.808206:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2895 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.808214:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2895 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.808220:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aad800 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786423.808225:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2895 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.808233:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2895 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.808252:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5210c81400) 00010000:00010000:0.0:1787786423.808255:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786423.808270:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2895 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.808277:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2895 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786423.809366:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786423.809753:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667899392 00000100:00100000:3.0:1787786423.809764:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667899392 00000100:00100000:3.0:1787786423.810217:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 106 00000100:00100000:3.0:1787786423.810230:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52088b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+52:10558:x1874629667899392:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:3.0:1787786423.810265:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786423.810286:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff289c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75236a expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.810380:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff28a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.810409:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff2887 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752363 expref: 53 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.810418:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff28a3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.810466:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff2887 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752363 expref: 53 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.810480:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff2887 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752363 expref: 53 pid: 8713 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786423.810496:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237b521c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874629686787584:192.168.204.34@tcp:104: 00000100:00100000:3.0:1787786423.810589:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5237b013c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787786423.814388:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237b521c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874629686787584:192.168.204.34@tcp:104: 00010000:00010000:2.0:1787786423.814422:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff28a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786423.814641:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786423.814717:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667899520 00000100:00100000:2.0:1787786423.814724:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667899520 00010000:00010000:2.0:1787786423.814769:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff2887 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752363 expref: 54 pid: 8713 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786423.814836:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 53 00000100:00100000:2.0:1787786423.814846:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237b50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+54:2364:x1874629667899520:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787786423.814862:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787786423.814869:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff2887 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752363 expref: 54 pid: 8713 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.814905:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff2887 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752363 expref: 54 pid: 8713 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.814928:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff2887 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752363 expref: 54 pid: 8713 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.814944:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5210c81400) 00010000:00010000:2.0:1787786423.814960:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff28a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.814977:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff28a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.814985:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff28a3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.815014:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787786423.815083:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237b50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+53:2364:x1874629667899520:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 238us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786423.815091:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 53 00010000:00010000:0.0:1787786423.815286:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff28a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.815305:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff28a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787786423.815364:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787786423.815369:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787786423.815392:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff28a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.815426:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff289c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75236a expref: 53 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.815442:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff28a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75236a expref: 52 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.815449:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5210c81400) 00010000:00010000:0.0:1787786423.815461:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787786423.815464:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb7e00, rc 0) 00000100:00100000:0.0:1787786423.815506:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52088b6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+52:10558:x1874629667899392:12345-192.168.204.34@tcp:101:bash.0 Request processed in 5280us (6147us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786423.815513:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 106 00000100:00100000:3.0:1787786423.823612:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786423.824683:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667899776 00000100:00100000:1.0:1787786423.824697:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667899776 00000100:00100000:1.0:1787786423.824824:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 29 00000100:00100000:1.0:1787786423.824835:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237b53840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+52:10558:x1874629667899776:12345-192.168.204.34@tcp:35:bash.0 00000100:00100000:1.0:1787786423.825086:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237b53840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+53:10558:x1874629667899776:12345-192.168.204.34@tcp:35:bash.0 Request processed in 252us (1483us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1787786423.825096:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 29 00000100:00100000:2.0:1787786423.905595:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786423.905679:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667899904 00000100:00100000:1.0:1787786423.905690:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667899904 00000100:00100000:1.0:1787786423.905762:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 107 00000100:00100000:1.0:1787786423.905773:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52088b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+53:10564:x1874629667899904:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:1.0:1787786423.905838:0:8713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786423.905858:0:8713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9e00/0x450132973bff28aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752371 expref: -99 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.905927:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff28b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.905941:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff28b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.905953:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff28b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787786423.906043:0:8713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1787786423.906046:0:8713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787786423.906070:0:8713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff28b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.906095:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9e00/0x450132973bff28aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752371 expref: 55 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.906114:0:8713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff28b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752371 expref: 54 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.906123:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b52100f1600) 00010000:00010000:1.0:1787786423.906127:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787786423.906130:0:8713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523b4d9200, rc 0) 00000100:00100000:1.0:1787786423.906203:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52088b5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+54:10564:x1874629667899904:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 431us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786423.906212:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 107 00000100:00100000:2.0:1787786423.909428:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786423.909666:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667900032 00000100:00100000:3.0:1787786423.909678:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667900032 00000100:00100000:3.0:1787786423.909785:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 108 00000100:00100000:3.0:1787786423.909837:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52088b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+54:10564:x1874629667900032:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:3.0:1787786423.909860:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786423.909882:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff28b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752378 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.909950:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff28bf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.909985:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff28bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.909996:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff28bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.910011:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff28c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.910018:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff28c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.910024:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff28c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.910135:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff28cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.910143:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff28cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.910150:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff28cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786423.910182:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787786423.910186:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787786423.910206:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff28cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.910218:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff28cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.910237:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff28bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.910243:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff28bf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.910250:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff28bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.910268:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7a00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786423.910273:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff28bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.910280:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff28bf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.910294:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b52100f1600) 00010000:00010000:3.0:1787786423.910296:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786423.910301:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff28bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.910307:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff28bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.910321:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff28c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.910328:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff28c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.910333:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff28c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.910344:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb6200 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786423.910347:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff28c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.910353:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff28c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.910377:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b5204e6fe00) 00010000:00010000:3.0:1787786423.910379:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786423.910382:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff28c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.910388:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff28c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.910419:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff28b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752378 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.911078:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff28cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752378 expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.911092:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5210c81400) 00010000:00010000:3.0:1787786423.911094:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787786423.911098:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb6a00, rc 0) 00000100:00100000:3.0:1787786423.911207:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52088b61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+55:10564:x1874629667900032:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 1370us (1789us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786423.911216:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 108 00000100:00100000:3.0:1787786423.923044:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786423.923108:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786423.923230:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667900416 00000100:00100000:1.0:1787786423.923241:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667900416 00000100:00100000:1.0:1787786423.923321:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:1.0:1787786423.923331:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237b521c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:173d08e0-0e54-474e-858e-1679cd38cf14+55:2362:x1874629667900416:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787786423.923347:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786423.923384:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff28cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752378 expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.923404:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5210c81400) 00010000:00010000:1.0:1787786423.923417:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786423.923486:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237b521c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:173d08e0-0e54-474e-858e-1679cd38cf14+54:2362:x1874629667900416:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 156us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786423.923494:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:0.0:1787786423.924481:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667900288 00000100:00100000:0.0:1787786423.924490:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667900288 00000100:00100000:0.0:1787786423.924727:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 109 00000100:00100000:0.0:1787786423.924740:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237b53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+54:10564:x1874629667900288:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1787786423.924774:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786423.924832:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff28d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75237f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.924973:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff28db lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.924988:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff28a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75236a expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.924995:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff28db lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.925029:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff28a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75236a expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.925043:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff28a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75236a expref: 55 pid: 5847 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786423.925056:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5205316580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874629686787712:192.168.204.34@tcp:104: 00000100:00100000:0.0:1787786423.925139:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5210e6b000 going to sleep for 11 seconds 00000100:00100000:0.0:1787786423.928038:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5205316580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874629686787712:192.168.204.34@tcp:104: 00010000:00010000:0.0:1787786423.928069:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff28db lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786423.929588:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786423.930333:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667900544 00000100:00100000:0.0:1787786423.930345:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667900544 00010000:00010000:0.0:1787786423.930390:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff28a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75236a expref: 56 pid: 5847 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786423.930484:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 54 00000100:00100000:2.0:1787786423.930499:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5211bfb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+56:2365:x1874629667900544:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787786423.930516:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787786423.930525:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff28a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75236a expref: 56 pid: 5847 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.930565:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff28a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75236a expref: 56 pid: 5847 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.930589:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff28a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75236a expref: 56 pid: 5847 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.930604:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5210c81400) 00010000:00010000:2.0:1787786423.930610:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff28db lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.930619:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff28db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.930638:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff28db lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.930669:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787786423.930735:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5211bfb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+55:2365:x1874629667900544:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 239us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786423.930744:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 54 00010000:00010000:0.0:1787786423.931495:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff28db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.931519:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff28db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787786423.931538:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787786423.931734:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff28d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75237f expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.931763:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff28db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75237f expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786423.931772:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5210c81400) 00010000:00010000:0.0:1787786423.931775:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787786423.931778:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912da00, rc 0) 00000100:00100000:0.0:1787786423.931853:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237b53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+56:10564:x1874629667900288:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 7116us (8820us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1787786423.931861:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 109 00000100:00100000:3.0:1787786423.936106:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786423.936249:0:8508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667900800 00000100:00100000:2.0:1787786423.936269:0:8508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667900800 00000100:00100000:2.0:1787786423.936330:0:8508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00100000:2.0:1787786423.936340:0:8508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237b52580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:173d08e0-0e54-474e-858e-1679cd38cf14+55:10564:x1874629667900800:12345-192.168.204.34@tcp:103:lfs.0 00010000:00010000:2.0:1787786423.936422:0:8508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787786423.936451:0:8508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff283a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752355 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786423.936554:0:8508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5210c81400) 00010000:00010000:2.0:1787786423.936560:0:8508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787786423.936667:0:8508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237b52580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:173d08e0-0e54-474e-858e-1679cd38cf14+54:10564:x1874629667900800:12345-192.168.204.34@tcp:103:lfs.0 Request processed in 328us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786423.936676:0:8508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00100000:3.0:1787786423.943328:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786423.943495:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667900928 00000100:00100000:1.0:1787786423.943506:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667900928 00000100:00100000:1.0:1787786423.943605:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 110 00000100:00100000:1.0:1787786423.943616:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237b50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+54:10564:x1874629667900928:12345-192.168.204.34@tcp:58:lfs.0 00010000:00010000:1.0:1787786423.943730:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9600/0x450132973bff28e9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.943747:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9600/0x450132973bff28e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786423.943768:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9600/0x450132973bff28e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787786423.944013:0:8713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1787786423.944107:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237b50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+54:10564:x1874629667900928:12345-192.168.204.34@tcp:58:lfs.0 Request processed in 492us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786423.944115:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 110 00000100:00100000:0.0:1787786423.946882:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786423.946974:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667901056 00000100:00100000:3.0:1787786423.946984:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667901056 00000100:00100000:3.0:1787786423.947052:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 111 00000100:00100000:3.0:1787786423.947063:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5205316580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+54:10564:x1874629667901056:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:3.0:1787786423.947090:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786423.947114:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff28f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752386 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.947180:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9600/0x450132973bff28e9 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.947191:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff28f0 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752386 expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.947222:0:5846:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9600/0x450132973bff28e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.947242:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff28f0 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752386 expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.947266:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5210c81400) 00010000:00010000:3.0:1787786423.947270:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787786423.947274:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff28f0 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752386 expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786423.947302:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb6800, rc 0) 00000100:00100000:3.0:1787786423.947376:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5205316580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+55:10564:x1874629667901056:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 315us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786423.947384:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 111 00000100:00100000:3.0:1787786424.242240:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786424.242460:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667901184 00000100:00100000:0.0:1787786424.242470:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667901184 00000100:00100000:0.0:1787786424.242529:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 281 00000100:00100000:0.0:1787786424.242539:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2365:x1874629667901184:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1787786424.242630:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2365:x1874629667901184:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 92us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786424.242638:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 281 00000100:00100000:0.0:1787786424.245471:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786424.245566:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667901312 00000100:00100000:2.0:1787786424.245575:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667901312 00000100:00100000:2.0:1787786424.245635:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 122 00000100:00100000:2.0:1787786424.245646:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52053170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+55:2365:x1874629667901312:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786424.245719:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52053170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+55:2365:x1874629667901312:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 75us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786424.245726:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 122 00000100:00100000:3.0:1787786424.245933:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786424.246015:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667901568 00000100:00100000:2.0:1787786424.246020:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667901568 00000100:00100000:1.0:1787786424.246022:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786424.246105:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786424.246126:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667901696 00000100:00100000:1.0:1787786424.246130:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667901696 00000100:00080000:1.0:1787786424.246150:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787786424.246175:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 123 00000100:00100000:1.0:1787786424.246183:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e407027-7940-45d9-87d7-56031cd08b7a+5:2364:x1874629667901696:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1787786424.246230:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e407027-7940-45d9-87d7-56031cd08b7a+5:2364:x1874629667901696:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 47us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786424.246263:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 123 00000100:00100000:2.0:1787786424.246339:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667901440 00000100:00100000:2.0:1787786424.246343:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667901440 00000100:00100000:1.0:1787786424.246369:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 67 00000100:00100000:1.0:1787786424.246378:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237b521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:173d08e0-0e54-474e-858e-1679cd38cf14+9:2364:x1874629667901568:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1787786424.246410:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237b521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:173d08e0-0e54-474e-858e-1679cd38cf14+9:2364:x1874629667901568:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 34us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786424.246417:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 67 00000100:00080000:1.0:1787786424.246701:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787786424.246707:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 68 00000100:00100000:2.0:1787786424.246716:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b951a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:173d08e0-0e54-474e-858e-1679cd38cf14+8:2364:x1874629667901440:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786424.246760:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b951a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:173d08e0-0e54-474e-858e-1679cd38cf14+8:2364:x1874629667901440:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 45us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786424.246767:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 68 00000040:00080000:2.0:1787786424.458190:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787786424.458202:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787786424.458289:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1787786424.458297:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787786424.458429:0:11693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52088b5e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874629686787840:192.168.204.34@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787786424.458546:0:11693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52328bdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787786424.466075:0:11693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52088b5e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874629686787840:192.168.204.34@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787786424.466989:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786424.467325:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667901824 00000100:00100000:2.0:1787786424.467338:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667901824 00000100:00100000:2.0:1787786424.467399:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 112 00000100:00100000:2.0:1787786424.467409:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+55:10565:x1874629667901824:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787786424.467448:0:7644:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787786424.467551:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+55:10565:x1874629667901824:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 Request processed in 143us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786424.467559:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 112 00000100:00100000:1.0:1787786424.478494:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786424.479395:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667901952 00000100:00100000:2.0:1787786424.479407:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667901952 00000100:00100000:2.0:1787786424.479477:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 113 00000100:00100000:2.0:1787786424.479486:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b9503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+55:10565:x1874629667901952:12345-192.168.204.34@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787786424.479558:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff28f7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.479576:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff28f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.479586:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff28f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.479601:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff28fe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.479608:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff28fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.479631:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff28fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.479654:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2905 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.479663:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.479670:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786424.479719:0:8713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787786424.479724:0:8713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787786424.479737:0:8713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.479747:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff28f7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.479753:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff28f7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.479759:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff28f7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.479765:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aacc00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786424.479769:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff28f7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.479776:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff28f7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.479884:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b5210c81800) 00010000:00010000:2.0:1787786424.479888:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786424.479892:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff28f7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.479900:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff28f7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.479912:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff28fe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.479919:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff28fe lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.479925:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff28fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.479930:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aac400 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786424.479933:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff28fe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.479939:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff28fe lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.479945:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8b5210c81f00) 00010000:00010000:2.0:1787786424.479947:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786424.479950:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff28fe lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.479956:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff28fe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.479984:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2905 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.479990:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2905 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.479995:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2905 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.480000:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aac600 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786424.480003:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2905 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.480008:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2905 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.480016:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5210c81400) 00010000:00010000:2.0:1787786424.480018:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786424.480021:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2905 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.480027:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2905 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786424.480110:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b9503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+55:10565:x1874629667901952:12345-192.168.204.34@tcp:34:lhsmtool_posix.0 Request processed in 624us (1625us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786424.480118:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 113 00000100:00100000:1.0:1787786424.483571:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786424.483990:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667902208 00000100:00100000:0.0:1787786424.484016:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667902208 00000100:00100000:0.0:1787786424.484080:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 114 00000100:00100000:0.0:1787786424.484090:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b950780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+55:10565:x1874629667902208:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787786424.484112:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786424.484133:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff290c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75238d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.484241:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff2913 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.484266:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff2913 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.484278:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff2913 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787786424.484289:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787786424.484390:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff2913 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.484398:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff2913 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.484405:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff2913 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.484411:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912d200 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786424.484415:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff2913 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.484422:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff2913 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.484442:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5210c81400) 00010000:00010000:0.0:1787786424.484445:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787786424.484451:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff2913 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.484458:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff2913 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.484502:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff290c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75238d expref: 57 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.484512:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b5210c81800) 00010000:00010000:0.0:1787786424.484514:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787786424.484518:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff290c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75238d expref: 57 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.484526:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912c200, rc 0) 00000100:00100000:0.0:1787786424.484590:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b950780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+56:10565:x1874629667902208:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 501us (1029us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1787786424.484599:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 114 00000100:00100000:0.0:1787786424.493631:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786424.495984:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667902336 00000100:00100000:2.0:1787786424.495998:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667902336 00000100:00100000:2.0:1787786424.496151:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 115 00000100:00100000:2.0:1787786424.496178:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52053161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+56:10565:x1874629667902336:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787786424.496222:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787786424.496360:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52053161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+56:10565:x1874629667902336:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 Request processed in 185us (2738us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786424.496368:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 115 00000100:00100000:1.0:1787786424.500688:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786424.500839:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667902592 00000100:00100000:3.0:1787786424.500849:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667902592 00000100:00100000:3.0:1787786424.500915:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 116 00000100:00100000:3.0:1787786424.500924:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b950b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+56:10565:x1874629667902592:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787786424.500945:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786424.500948:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787786424.500975:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff28b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752371 expref: 56 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.500996:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b52100f1600) 00010000:00010000:3.0:1787786424.501001:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787786424.501018:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2921 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752394 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787786424.501464:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1787786424.502234:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff2928 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.502272:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff2928 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.502311:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff2928 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.502395:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2921 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752394 expref: 58 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.502428:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff2928 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752394 expref: 57 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.502438:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8b5204e6fe00) 00010000:00010000:3.0:1787786424.502441:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787786424.502446:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb7a00, rc 0) 00000100:00100000:3.0:1787786424.502540:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b950b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+57:10565:x1874629667902592:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 1614us (1859us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1787786424.502550:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 116 00000100:00100000:3.0:1787786424.508547:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786424.508958:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667902848 00000100:00100000:2.0:1787786424.508973:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667902848 00000100:00100000:2.0:1787786424.509055:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 117 00000100:00100000:2.0:1787786424.509067:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+57:10565:x1874629667902848:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787786424.509154:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787786424.509201:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff2928 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752394 expref: 57 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.509225:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8b5204e6fe00) 00010000:00010000:2.0:1787786424.509239:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787786424.509275:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2936 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.509292:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2936 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.509303:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2936 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.510870:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff293d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x9d86ccb9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.510895:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff293d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9d86ccb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.511027:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff293d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9d86ccb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.511297:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2936 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.511305:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2936 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.511313:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2936 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.511319:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aac600 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786424.511323:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2936 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.511332:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2936 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.511451:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b52100f1600) 00010000:00010000:2.0:1787786424.511455:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786424.511460:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2936 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.511466:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff2936 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.511481:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff293d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x9d86ccb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.511487:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff293d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9d86ccb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.511502:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff293d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9d86ccb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.511507:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aac400 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786424.511509:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff293d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9d86ccb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.511515:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff293d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x9d86ccb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.511523:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x9d86ccb9 (ffff8b5210c81f00) 00010000:00010000:2.0:1787786424.511525:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786424.511527:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff293d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9d86ccb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.511531:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff293d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x9d86ccb9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786424.511657:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a352c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+56:10565:x1874629667902848:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 Request processed in 2588us (3121us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787786424.511667:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 117 00000100:00100000:0.0:1787786424.516785:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786424.517127:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667902976 00000100:00100000:2.0:1787786424.517141:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667902976 00000100:00100000:2.0:1787786424.517263:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 118 00000100:00100000:2.0:1787786424.517275:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5205316d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+56:10565:x1874629667902976:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787786424.517307:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786424.517339:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2944 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75239b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.517414:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff294b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.517432:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff294b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.517456:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff294b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.517581:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2944 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75239b expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.517605:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff294b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75239b expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.517615:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8b5210c81f00) 00010000:00010000:2.0:1787786424.517619:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787786424.517624:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aac600, rc 0) 00000100:00100000:2.0:1787786424.517700:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5205316d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+57:10565:x1874629667902976:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 428us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786424.517709:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 118 00000100:00100000:2.0:1787786424.524682:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786424.524942:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667903232 00000100:00100000:3.0:1787786424.524956:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667903232 00000100:00100000:3.0:1787786424.525102:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 119 00000100:00100000:3.0:1787786424.525118:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52088b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+57:10565:x1874629667903232:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787786424.525288:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2952 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.525312:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2952 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.525325:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2952 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787786424.526111:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:3.0:1787786424.526127:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 350884335451ns, next at 351884331831ns, rc = 0 00000004:00010000:3.0:1787786424.526236:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000453bdf8e reply state 00000000039d7be0 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2952 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786424.526260:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787786424.526447:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52088b5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+59:10565:x1874629667903232:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 Request processed in 1329us (1776us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1787786424.526465:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 119 00000100:00100000:3.0:1787786424.531219:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00010000:00010000:0.0:1787786424.531359:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2952 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.531374:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2952 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.531382:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2952 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.531410:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb6200 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786424.531416:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2952 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.531424:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2952 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.531457:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8b5210c81f00) 00010000:00010000:0.0:1787786424.531461:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787786424.531467:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2952 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.531474:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2952 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786424.531698:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667903360 00000100:00100000:1.0:1787786424.531711:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667903360 00000100:00100000:1.0:1787786424.531915:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 120 00000100:00100000:1.0:1787786424.531928:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bfdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+58:10565:x1874629667903360:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787786424.531960:0:8713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786424.531983:0:8713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9800/0x450132973bff2959 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7523a2 expref: -99 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.532059:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9800/0x450132973bff2959 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523a2 expref: 59 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.532071:0:8713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9800/0x450132973bff2959 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523a2 expref: 59 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.532087:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8b5210c81f00) 00010000:00010000:1.0:1787786424.532096:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787786424.532150:0:8713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523b4d9800, rc 0) 00000100:00100000:1.0:1787786424.532235:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bfdf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+59:10565:x1874629667903360:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 309us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786424.532255:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 120 00000100:00100000:0.0:1787786424.536038:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786424.536131:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667903488 00000100:00100000:1.0:1787786424.536145:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667903488 00000100:00100000:1.0:1787786424.536264:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 37 00000100:00100000:1.0:1787786424.536276:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5207203050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:173d08e0-0e54-474e-858e-1679cd38cf14+8:2364:x1874629667903488:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787786424.537056:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5207203050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:173d08e0-0e54-474e-858e-1679cd38cf14+9:2364:x1874629667903488:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 Request processed in 775us (1027us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787786424.537068:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 37 00000100:00100000:2.0:1787786424.543418:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786424.546030:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667903744 00000100:00100000:3.0:1787786424.546052:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667903744 00000100:00100000:2.0:1787786424.546276:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 30 00000100:00100000:2.0:1787786424.546292:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52088b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+59:10565:x1874629667903744:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787786424.546729:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52088b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+60:10565:x1874629667903744:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 Request processed in 439us (3326us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1787786424.546759:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 30 00000100:00100000:2.0:1787786424.550152:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786424.550300:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667904000 00000100:00100000:0.0:1787786424.550315:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667904000 00000100:00100000:0.0:1787786424.551829:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 121 00000100:00100000:1.0:1787786424.552001:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52088b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+60:10565:x1874629667904000:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787786424.552161:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52088b52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+60:10565:x1874629667904000:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 319us (2025us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786424.552172:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 121 00000100:00100000:0.0:1787786424.558188:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786424.558287:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667904128 00000100:00100000:3.0:1787786424.558297:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667904128 00000100:00100000:3.0:1787786424.558359:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 122 00000100:00100000:3.0:1787786424.558368:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206204780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+60:10565:x1874629667904128:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787786424.558389:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786424.558409:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2960 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7523a9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.558490:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2967 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.558506:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2967 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.558518:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2967 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786424.558573:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787786424.558592:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2967 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.558622:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2960 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523a9 expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.558640:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2967 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523a9 expref: 61 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.558648:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8b5210c81f00) 00010000:00010000:3.0:1787786424.558652:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787786424.558655:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb6200, rc 0) 00000100:00100000:3.0:1787786424.558716:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206204780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+61:10565:x1874629667904128:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 349us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786424.558724:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 122 00000100:00100000:3.0:1787786424.562639:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786424.563782:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667904256 00000100:00100000:2.0:1787786424.563861:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667904256 00000100:00100000:2.0:1787786424.563949:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 38 00000100:00100000:2.0:1787786424.563963:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bfdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:173d08e0-0e54-474e-858e-1679cd38cf14+9:2365:x1874629667904256:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787786424.563987:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786424.564018:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000816fb9c1/0x450132973bff296e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7523b0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787786424.564054:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f74b8, blocks: 0x1 00010000:00010000:2.0:1787786424.564087:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=350s v=(0 0) 00010000:00010000:2.0:1787786424.564093:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787786424.564107:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000816fb9c1/0x450132973bff296e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523b0 expref: 10 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.564133:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000816fb9c1/0x450132973bff296e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523b0 expref: 10 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.564150:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aac000, rc 0) 00000100:00100000:2.0:1787786424.564257:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bfdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:173d08e0-0e54-474e-858e-1679cd38cf14+10:2365:x1874629667904256:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 297us (1634us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786424.564266:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 38 00000100:00100000:2.0:1787786424.569663:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786424.569781:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667904512 00000100:00100000:1.0:1787786424.569989:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667904512 00000100:00100000:1.0:1787786424.570076:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 123 00000100:00100000:1.0:1787786424.570088:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52088b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+61:10565:x1874629667904512:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787786424.570269:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52088b7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+61:10565:x1874629667904512:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 180us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786424.570279:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 123 00000100:00100000:1.0:1787786424.578777:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786424.581119:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667904640 00000100:00100000:3.0:1787786424.581141:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667904640 00000100:00100000:1.0:1787786424.582126:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 39 00000100:00100000:1.0:1787786424.582163:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b952580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+10:10565:x1874629667904640:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787786424.582190:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786424.582228:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d26cf718/0x450132973bff2975 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7523b7 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.582279:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000816fb9c1/0x450132973bff296e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523b0 expref: 11 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.582291:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786424.582295:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786424.582301:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d26cf718/0x450132973bff2975 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523b7 expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.582345:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000816fb9c1/0x450132973bff296e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523b0 expref: 11 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.582361:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000816fb9c1/0x450132973bff296e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523b0 expref: 11 pid: 6698 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786424.582377:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b951a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6699:1874629686787968:192.168.204.34@tcp:104: 00000100:00100000:1.0:1787786424.582528:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5204d16000 going to sleep for 11 seconds 00000100:00100000:2.0:1787786424.590751:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786424.592509:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b951a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6699:1874629686787968:192.168.204.34@tcp:104: 00010000:00010000:1.0:1787786424.592577:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d26cf718/0x450132973bff2975 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523b7 expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.592633:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523b4d8800, rc 0) 00000100:00100000:1.0:1787786424.592733:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b952580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+11:10565:x1874629667904640:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 10572us (13970us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786424.592743:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 39 00000100:00100000:3.0:1787786424.597560:0:11675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667904768 00000100:00100000:3.0:1787786424.597584:0:11675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667904768 00010000:00010000:2.0:1787786424.599013:0:11675:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000816fb9c1/0x450132973bff296e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523b0 expref: 11 pid: 6698 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786424.599149:0:11675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 55 00000100:00100000:2.0:1787786424.599163:0:11675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52088b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:173d08e0-0e54-474e-858e-1679cd38cf14+11:2364:x1874629667904768:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787786424.599185:0:11675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787786424.599216:0:11675:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000816fb9c1/0x450132973bff296e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523b0 expref: 11 pid: 6698 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.599232:0:11675:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000816fb9c1/0x450132973bff296e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523b0 expref: 11 pid: 6698 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.599273:0:11675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000816fb9c1/0x450132973bff296e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523b0 expref: 11 pid: 6698 timeout: 450 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.599294:0:11675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787786424.599311:0:11675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787786424.599321:0:11675:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d26cf718/0x450132973bff2975 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523b7 expref: 10 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.599332:0:11675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d26cf718/0x450132973bff2975 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523b7 expref: 10 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.599391:0:11675:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d26cf718/0x450132973bff2975 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523b7 expref: 10 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786424.599450:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5206352940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11675:1874629686788096:192.168.204.34@tcp:105: 00000100:00100000:2.0:1787786424.599572:0:11675:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52328bdc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787786424.608271:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5206352940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11675:1874629686788096:192.168.204.34@tcp:105: 00010000:00010000:1.0:1787786424.608308:0:11675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786424.608377:0:11675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52088b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:173d08e0-0e54-474e-858e-1679cd38cf14+10:2364:x1874629667904768:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 9217us (17646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786424.608392:0:11675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 55 00000100:00100000:3.0:1787786424.610965:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786424.611556:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667904896 00000100:00100000:2.0:1787786424.611572:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667904896 00002000:00100000:2.0:1787786424.611647:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8b523bfdfc00 x1874629667904896/t0(0) o4->173d08e0-0e54-474e-858e-1679cd38cf14@192.168.204.34@tcp:40/0 lens 504/0 e 0 to 0 dl 1787786435 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787786424.611661:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8b523bfdfc00 with x1874629667904896 ext(0->12) 00002000:00010000:2.0:1787786424.611668:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b523bfdfc00 00000100:00100000:2.0:1787786424.611712:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 2 00000100:00100000:2.0:1787786424.611723:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bfdfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:173d08e0-0e54-474e-858e-1679cd38cf14+10:2364:x1874629667904896:12345-192.168.204.34@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787786424.612380:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bfdfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:173d08e0-0e54-474e-858e-1679cd38cf14+12:2364:x1874629667904896:12345-192.168.204.34@tcp:4:lhsmtool_posix.0 Request processed in 654us (1423us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787786424.612392:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 2 00002000:00100000:2.0:1787786424.612401:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8b523bfdfc00 x1874629667904896/t4294967308(0) o4->173d08e0-0e54-474e-858e-1679cd38cf14@192.168.204.34@tcp:40/0 lens 504/448 e 0 to 0 dl 1787786435 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787786424.612411:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8b523bfdfc00 with x1874629667904896 ext(0->12) 00002000:00010000:2.0:1787786424.612415:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b523bfdfc00 00000100:00100000:0.0:1787786424.616975:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786424.617762:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667905024 00000100:00100000:2.0:1787786424.617777:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667905024 00000100:00100000:2.0:1787786424.618105:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 124 00000100:00100000:2.0:1787786424.618123:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206204b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+61:10565:x1874629667905024:12345-192.168.204.34@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1787786424.675063:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000004:00080000:0.0:1787786424.675105:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:0.0:1787786424.675200:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:0.0:1787786424.675221:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b520133a000 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1787786424.675227:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8b51029f0500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b5213495540 00000020:00080000:0.0:1787786424.675230:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8b51029f0d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b51033ef400 00000020:00080000:0.0:1787786424.675262:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b5203e75240 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1787786424.675341:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8b51029f0f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b5203e75780 00000020:00080000:0.0:1787786424.675344:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8b51029f0b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b51033ed400 00000001:00080000:0.0:1787786424.675363:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000100:00100000:3.0:1787786424.675371:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206204b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+32:10565:x1874629667905024:12345-192.168.204.34@tcp:44:lhsmtool_posix.0 Request processed in 57247us (58403us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786424.675384:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 124 00000004:00080000:0.0:1787786424.675468:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:0.0:1787786424.675497:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1787786424.675783:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:3.0:1787786424.675903:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52062070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686788224:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787786424.675968:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1787786424.676020:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1787786424.676033:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5206207840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686788352:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787786424.676064:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786424.676102:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5206206940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686788480:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787786424.676165:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686788224 00000100:00100000:3.0:1787786424.676174:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686788224 00000100:00100000:0.0:1787786424.676215:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786424.676235:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686788352 00000100:00100000:3.0:1787786424.676238:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686788352 00000100:00100000:3.0:1787786424.676263:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686788480 00000100:00100000:3.0:1787786424.676265:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686788480 00000100:00100000:0.0:1787786424.676269:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787786424.676281:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787786424.676288:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206205680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1874629686788352:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1787786424.676456:0:8126:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787786424.676460:0:8126:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787786424 00002000:00010000:3.0:1787786424.676463:0:8126:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787786424.676465:0:8126:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787786424 -> 1787786424 00002000:00010000:3.0:1787786424.676468:0:8126:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787786424.676576:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bfdde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3311:x1874629686788224:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787786424.676580:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206205680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3312:x1874629686788352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 293us (516us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787786424.676588:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00002000:00080000:0.0:1787786424.676594:0:6700:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00000100:00100000:3.0:1787786424.676604:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787786424.676611:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206206580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3313:x1874629686788480:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787786424.676623:0:8126:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:3.0:1787786424.676653:0:8126:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a8f74b7, atime: 0x6a8f74b7, ctime: 0x6a8f74b7, blocks: 0x1 00010000:00010000:3.0:1787786424.676663:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005dfcc627/0x450132973bff297c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.676678:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a292851a/0x450132973bff2983 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.676683:0:8126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=351s v=(0 0) 00010000:00010000:3.0:1787786424.676688:0:8126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787786424.676694:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b7c0f557/0x450132973bff273e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752316 expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.676695:0:8126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005dfcc627/0x450132973bff297c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.676703:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1787786424.676705:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787786424.676710:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a292851a/0x450132973bff2983 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.676727:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005dfcc627/0x450132973bff297c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.676762:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b7c0f557/0x450132973bff273e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752316 expref: 11 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.676785:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b7c0f557/0x450132973bff273e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752316 expref: 11 pid: 6699 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786424.676826:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52332c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6700:1874629686788608:192.168.204.34@tcp:104: 00000100:00100000:0.0:1787786424.676890:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5210e6b480 going to sleep for 11 seconds 00000004:00080000:0.0:1787786424.676930:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b5206207840/2, rc 0, transno 4294967309 00000100:00100000:0.0:1787786424.676937:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5206207840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686788352:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1787786424.676965:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005dfcc627/0x450132973bff297c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.676973:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005dfcc627/0x450132973bff297c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.676994:0:8126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787786424.678126:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00080000:1.0:1787786424.678253:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787786424.678256:0:6698:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00080000:1.0:1787786424.678260:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787786424.678274:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787786424.678285:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005dfcc627/0x450132973bff297c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786424.678286:0:6698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00010000:00010000:1.0:1787786424.678302:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7a00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:1.0:1787786424.678309:0:7633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005dfcc627/0x450132973bff297c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.678323:0:7633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005dfcc627/0x450132973bff297c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.678399:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005dfcc627/0x450132973bff297c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.678422:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005dfcc627/0x450132973bff297c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786424.678922:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206206580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3313:x1874629686788480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2308us (2702us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787786424.678934:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787786424.678962:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667905152 00000100:00100000:3.0:1787786424.678970:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667905152 00000100:00100000:3.0:1787786424.679004:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 43 00000100:00100000:3.0:1787786424.679014:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52332c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+12:2365:x1874629667905152:12345-192.168.204.34@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1787786424.679266:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786424.679268:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786424.679271:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787786424.680653:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b5206206940/2, rc 0, transno 4294967304 00000100:00100000:0.0:1787786424.680680:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5206206940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686788480:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787786424.687394:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786424.687636:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52332c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6700:1874629686788608:192.168.204.34@tcp:104: 00010000:00010000:0.0:1787786424.687677:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a292851a/0x450132973bff2983 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786424.688037:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667905280 00000100:00100000:1.0:1787786424.688048:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667905280 00010000:00010000:1.0:1787786424.688107:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b7c0f557/0x450132973bff273e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752316 expref: 13 pid: 6699 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786424.688160:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 56 00000100:00100000:1.0:1787786424.688174:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52063530c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+13:2365:x1874629667905280:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787786424.688196:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786424.688203:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b7c0f557/0x450132973bff273e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752316 expref: 13 pid: 6699 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.688218:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b7c0f557/0x450132973bff273e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752316 expref: 13 pid: 6699 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.688264:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7c0f557/0x450132973bff273e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752316 expref: 13 pid: 6699 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.688285:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787786424.688292:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787786424.688316:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a292851a/0x450132973bff2983 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.688329:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a292851a/0x450132973bff2983 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.688368:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786424.688434:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52063530c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+12:2365:x1874629667905280:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 264us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786424.688443:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 56 00010000:00010000:3.0:1787786424.688483:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a292851a/0x450132973bff2983 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.688508:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a292851a/0x450132973bff2983 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.688521:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a292851a/0x450132973bff2983 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.688542:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a292851a/0x450132973bff2983 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.688567:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787786424.690599:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787786424.690619:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a292851a/0x450132973bff2983 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.690635:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912d200 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:1.0:1787786424.690641:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a292851a/0x450132973bff2983 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.690654:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a292851a/0x450132973bff2983 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.690680:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a292851a/0x450132973bff2983 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.690688:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a292851a/0x450132973bff2983 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.690741:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786424.690744:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786424.690746:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786424.695129:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bfdde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3311:x1874629686788224:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18836us (19146us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787786424.695149:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:3.0:1787786424.697895:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b52062070c0/2, rc 0, transno 4294967310 00000100:00100000:3.0:1787786424.697912:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52062070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686788224:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1787786424.721271:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:2.0:1787786424.721313:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:3.0:1787786424.721420:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52332c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+8:2365:x1874629667905152:12345-192.168.204.34@tcp:16:lhsmtool_posix.0 Request processed in 42396us (43293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786424.721435:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 43 00000001:00080000:2.0:1787786424.721589:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:2.0:1787786424.721599:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:0.0:1787786424.725848:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786424.725914:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667905536 00000100:00100000:1.0:1787786424.725929:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667905536 00000100:00100000:1.0:1787786424.726013:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 125 00000100:00100000:1.0:1787786424.726025:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52332c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+15:10565:x1874629667905536:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787786424.726111:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786424.726151:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2967 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523a9 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.726173:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8b5210c81f00) 00010000:00010000:1.0:1787786424.726179:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787786424.726223:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff298a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.726250:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff298a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.726263:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff298a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787786424.726591:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9bc8835 reply state 00000000b901b90b transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff298a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786424.727408:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787786424.727565:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52332c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+16:10565:x1874629667905536:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 Request processed in 1539us (1728us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1787786424.727608:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 125 00010000:00010000:1.0:1787786424.729573:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff298a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.729655:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff298a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.729665:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff298a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.729672:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8e00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786424.729677:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff298a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.729686:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff298a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.729704:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8b5210c81f00) 00010000:00010000:1.0:1787786424.729707:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787786424.729711:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff298a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.729718:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff298a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786424.731706:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786424.731788:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667905664 00000100:00100000:1.0:1787786424.731857:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667905664 00000100:00100000:1.0:1787786424.731949:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 44 00000100:00100000:1.0:1787786424.731960:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52332c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+6:2364:x1874629667905664:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787786424.732296:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1787786424.732330:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1787786424 -> 1787786423 00002000:00010000:1.0:1787786424.732333:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787786423 00002000:00010000:1.0:1787786424.732336:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1787786424 -> 1787786423 00002000:00010000:1.0:1787786424.732339:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787786424.732425:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52332c1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+7:2364:x1874629667905664:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 Request processed in 465us (731us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787786424.732435:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 44 00000100:00100000:0.0:1787786424.736528:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786424.736580:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667905920 00000100:00100000:1.0:1787786424.736593:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667905920 00000100:00100000:1.0:1787786424.736730:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 126 00000100:00100000:1.0:1787786424.736743:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52332c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+15:10565:x1874629667905920:12345-192.168.204.34@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787786424.736890:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff2991 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.736911:0:8713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff294b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75239b expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.736923:0:8713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff2991 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.736966:0:8713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff294b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75239b expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.736986:0:8713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff294b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75239b expref: 15 pid: 5847 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786424.737002:0:8713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b951a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8713:1874629686788736:192.168.204.34@tcp:104: 00000100:00100000:2.0:1787786424.737355:0:8713:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5211348600 going to sleep for 11 seconds 00000100:00100000:0.0:1787786424.744869:0:8713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b951a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8713:1874629686788736:192.168.204.34@tcp:104: 00010000:00010000:0.0:1787786424.745019:0:8713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff2991 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786424.748321:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786424.749283:0:8508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667906048 00000100:00100000:2.0:1787786424.749298:0:8508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667906048 00010000:00010000:2.0:1787786424.749357:0:8508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff294b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75239b expref: 16 pid: 5847 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786424.749455:0:8508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 57 00000100:00100000:2.0:1787786424.749467:0:8508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52332c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:173d08e0-0e54-474e-858e-1679cd38cf14+16:2365:x1874629667906048:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787786424.749487:0:8508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787786424.749496:0:8508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff294b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75239b expref: 16 pid: 5847 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.749513:0:8508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff294b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75239b expref: 16 pid: 5847 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.749542:0:8508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff294b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75239b expref: 16 pid: 5847 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.749564:0:8508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8b5210c81f00) 00010000:00010000:2.0:1787786424.749570:0:8508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff2991 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.749583:0:8508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff2991 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.749619:0:8508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff2991 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.749657:0:8508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787786424.749741:0:8508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52332c2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:173d08e0-0e54-474e-858e-1679cd38cf14+15:2365:x1874629667906048:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 275us (1435us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786424.749750:0:8508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 57 00010000:00010000:0.0:1787786424.750397:0:8713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff2991 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.750409:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff2991 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.750453:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff2991 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.750461:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff2991 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.750468:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff2991 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.750475:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8600 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786424.750481:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff2991 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.750490:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff2991 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.750503:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8b5210c81f00) 00010000:00010000:0.0:1787786424.750506:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787786424.750512:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff2991 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.750518:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff2991 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786424.750618:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52332c12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+14:10565:x1874629667905920:12345-192.168.204.34@tcp:55:lhsmtool_posix.0 Request processed in 13875us (14104us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787786424.750630:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 126 00000100:00100000:0.0:1787786424.754291:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786424.754349:0:12026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667906176 00000100:00100000:2.0:1787786424.754362:0:12026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667906176 00000100:00100000:2.0:1787786424.754437:0:12026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 45 00000100:00100000:2.0:1787786424.754451:0:12026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52332c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:173d08e0-0e54-474e-858e-1679cd38cf14+7:2364:x1874629667906176:12345-192.168.204.34@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787786424.754517:0:12026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000309a4d86/0x450132973bff2998 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.754547:0:12026:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d26cf718/0x450132973bff2975 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523b7 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.754558:0:12026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1787786424.754563:0:12026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787786424.754569:0:12026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309a4d86/0x450132973bff2998 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.754620:0:12026:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d26cf718/0x450132973bff2975 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523b7 expref: 7 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.754637:0:12026:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d26cf718/0x450132973bff2975 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523b7 expref: 7 pid: 6699 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786424.754676:0:12026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5206352940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12026:1874629686788864:192.168.204.34@tcp:104: 00000100:00100000:2.0:1787786424.754905:0:12026:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52328bdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787786424.757915:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786424.758204:0:12026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5206352940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12026:1874629686788864:192.168.204.34@tcp:104: 00010000:00010000:2.0:1787786424.758253:0:12026:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000309a4d86/0x450132973bff2998 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786424.758526:0:11675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667906304 00000100:00100000:1.0:1787786424.758554:0:11675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667906304 00010000:00010000:1.0:1787786424.758616:0:11675:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d26cf718/0x450132973bff2975 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523b7 expref: 8 pid: 6699 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786424.758666:0:11675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 58 00000100:00100000:1.0:1787786424.758677:0:11675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bfdc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:173d08e0-0e54-474e-858e-1679cd38cf14+8:2364:x1874629667906304:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787786424.758699:0:11675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786424.758731:0:11675:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d26cf718/0x450132973bff2975 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523b7 expref: 8 pid: 6699 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.758747:0:11675:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d26cf718/0x450132973bff2975 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523b7 expref: 8 pid: 6699 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.758779:0:11675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d26cf718/0x450132973bff2975 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523b7 expref: 8 pid: 6699 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.759093:0:11675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787786424.759100:0:11675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787786424.759107:0:11675:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000309a4d86/0x450132973bff2998 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.759121:0:11675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309a4d86/0x450132973bff2998 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.759160:0:11675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786424.759306:0:11675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bfdc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:173d08e0-0e54-474e-858e-1679cd38cf14+7:2364:x1874629667906304:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 629us (1404us total) trans 0 rc 0/0 00010000:00010000:2.0:1787786424.759325:0:12026:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000309a4d86/0x450132973bff2998 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.759339:0:12026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309a4d86/0x450132973bff2998 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786424.759342:0:11675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 58 00010000:00010000:2.0:1787786424.759378:0:12026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000309a4d86/0x450132973bff2998 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.759390:0:12026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309a4d86/0x450132973bff2998 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.759400:0:12026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309a4d86/0x450132973bff2998 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.759407:0:12026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aade00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:2.0:1787786424.759412:0:12026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309a4d86/0x450132973bff2998 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.759434:0:12026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309a4d86/0x450132973bff2998 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.761072:0:12026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309a4d86/0x450132973bff2998 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.761095:0:12026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309a4d86/0x450132973bff2998 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786424.761228:0:12026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52332c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:173d08e0-0e54-474e-858e-1679cd38cf14+6:2364:x1874629667906176:12345-192.168.204.34@tcp:1:lhsmtool_posix.0 Request processed in 6775us (6949us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786424.761253:0:12026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 45 00000100:00100000:3.0:1787786424.766652:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786424.766779:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667906560 00000100:00100000:2.0:1787786424.766829:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667906560 00000100:00100000:2.0:1787786424.766908:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 127 00000100:00100000:2.0:1787786424.766920:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+14:10565:x1874629667906560:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787786424.767052:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff299f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.767080:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff299f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.767097:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff299f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.767423:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff29a6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.767471:0:7644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9800/0x450132973bff2959 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523a2 expref: 15 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.767480:0:7644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff29a6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.767524:0:7644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9800/0x450132973bff2959 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523a2 expref: 15 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.767540:0:7644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9800/0x450132973bff2959 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523a2 expref: 15 pid: 8713 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786424.767558:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5206352940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7644:1874629686788992:192.168.204.34@tcp:104: 00000100:00100000:2.0:1787786424.767681:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52328bdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787786424.771118:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5206352940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7644:1874629686788992:192.168.204.34@tcp:104: 00010000:00010000:2.0:1787786424.771158:0:7644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff29a6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786424.772782:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786424.772975:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667906688 00000100:00100000:0.0:1787786424.772997:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667906688 00010000:00010000:0.0:1787786424.773063:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9800/0x450132973bff2959 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523a2 expref: 16 pid: 8713 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786424.773116:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 59 00000100:00100000:0.0:1787786424.773129:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206352940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:173d08e0-0e54-474e-858e-1679cd38cf14+16:2364:x1874629667906688:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787786424.773150:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787786424.773159:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9800/0x450132973bff2959 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523a2 expref: 16 pid: 8713 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.773174:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9800/0x450132973bff2959 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523a2 expref: 16 pid: 8713 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.773202:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9800/0x450132973bff2959 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523a2 expref: 16 pid: 8713 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.773223:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8b5210c81f00) 00010000:00010000:0.0:1787786424.773230:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff29a6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.773252:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff29a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.773280:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff29a6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.773314:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787786424.773393:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206352940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:173d08e0-0e54-474e-858e-1679cd38cf14+15:2364:x1874629667906688:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 267us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786424.773402:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 59 00010000:00010000:3.0:1787786424.773756:0:7644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff29a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.773766:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff29a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787786424.774209:0:7644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1787786424.774422:0:7644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1787786424.774480:0:7644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1787786424.774976:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c0ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7644:1874629686789120:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787786424.775089:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786424.775145:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52328bd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787786424.775288:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686789120 00000100:00100000:0.0:1787786424.775299:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686789120 00000100:00100000:0.0:1787786424.775370:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787786424.775381:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7644:x1874629686789120:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787786424.775485:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7644:x1874629686789120:12345-0@lo:1000:mdt00_003.0 Request processed in 105us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786424.775493:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787786424.775665:0:7644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1787786424.775672:0:7644:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:2.0:1787786424.775702:0:7644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b5206207840, transno 4294967309 00000100:00100000:2.0:1787786424.776335:0:7644:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8b52062070c0 x1874629686788224/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787786440 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786424.776366:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c0ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7644:1874629686789120:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1787786424.777955:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787786424.778496:0:7644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1787786424.778664:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c0ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7644:1874629686789248:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787786424.778946:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786424.779073:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52328bd300 going to sleep for 11 seconds 00000100:00100000:0.0:1787786424.779132:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686789248 00000100:00100000:0.0:1787786424.779140:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686789248 00000100:00100000:0.0:1787786424.779229:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787786424.779251:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7644:x1874629686789248:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1787786424.779505:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7644:x1874629686789248:12345-0@lo:1000:mdt00_003.0 Request processed in 265us (558us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787786424.779513:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787786424.779674:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c0ad00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7644:1874629686789248:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1787786424.779724:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff29a6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.779746:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff29a6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.779755:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff29a6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.779762:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aadc00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786424.779767:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff29a6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.779777:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff29a6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.779822:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8b5210c81f00) 00010000:00010000:2.0:1787786424.779826:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787786424.779832:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff29a6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.779839:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff29a6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.779895:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9600/0x450132973bff28e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.779901:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9600/0x450132973bff28e9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.779908:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9600/0x450132973bff28e9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.779913:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d9600 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786424.779916:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9600/0x450132973bff28e9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.779921:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9600/0x450132973bff28e9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.779928:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5210c81400) 00010000:00010000:2.0:1787786424.779931:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787786424.779939:0:7644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff28f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752386 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.779953:0:7644:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff28f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752386 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.779963:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff28f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752386 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.780003:0:7644:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff28f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752386 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786424.780029:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52328f1680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7644:1874629686789376:192.168.204.34@tcp:105: 00000100:00100000:2.0:1787786424.780116:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52328bd300 going to sleep for 11 seconds 00000100:00100000:2.0:1787786424.783588:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786424.783744:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667906816 00000100:00100000:1.0:1787786424.783757:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667906816 00000100:00100000:1.0:1787786424.783870:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 31 00000100:00100000:1.0:1787786424.783882:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+19:10564:x1874629667906816:12345-192.168.204.34@tcp:49:lfs.0 00000100:00100000:1.0:1787786424.784069:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+19:10564:x1874629667906816:12345-192.168.204.34@tcp:49:lfs.0 Request processed in 189us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786424.784080:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 31 00000100:00100000:3.0:1787786424.785069:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52328f1680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7644:1874629686789376:192.168.204.34@tcp:105: 00010000:00010000:3.0:1787786424.785108:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9600/0x450132973bff28e9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.785121:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9600/0x450132973bff28e9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.785189:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff29ad lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.785207:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff29ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.785219:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff29ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.785231:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff29ad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.785249:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff29ad lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.785257:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff29ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.785263:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7e00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786424.785267:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff29ad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.785274:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff29ad lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.785287:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5210c81400) 00010000:00010000:3.0:1787786424.785290:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786424.785294:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff29ad lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.785299:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff29ad lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.785318:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff299f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.785336:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff299f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.785343:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff299f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.785348:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aac600 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786424.785351:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff299f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.785357:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff299f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.785366:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5210c81400) 00010000:00010000:3.0:1787786424.785369:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787786424.785372:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff299f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.785377:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff299f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786424.785685:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+18:10565:x1874629667906560:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 18766us (19164us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1787786424.785696:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 127 00000020:00080000:3.0:1787786424.785703:0:7644:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787786424.786544:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787786424.786553:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787786424.787196:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787786424.787209:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787786424.795548:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786424.795726:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786424.795870:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667907072 00000100:00100000:0.0:1787786424.795883:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667907072 00000100:00100000:0.0:1787786424.795958:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 128 00000100:00100000:0.0:1787786424.795971:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+18:10564:x1874629667907072:12345-192.168.204.34@tcp:58:lfs.0 00000040:00080000:0.0:1787786424.796561:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1787786424.796684:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+18:10564:x1874629667907072:12345-192.168.204.34@tcp:58:lfs.0 Request processed in 715us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786424.796694:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 128 00000100:00100000:1.0:1787786424.798262:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667907328 00000100:00100000:1.0:1787786424.798287:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667907328 00000100:00100000:1.0:1787786424.798365:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 32 00000100:00100000:1.0:1787786424.798376:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52062fc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+18:10565:x1874629667907328:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787786424.802564:0:5850:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787786424.802708:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1787786424.802846:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff29b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.802869:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff29b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.802882:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff29b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.802892:0:5850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff29b4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.802899:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff29b4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.802917:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff29b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.802944:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787786424.803006:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787786424.803016:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff29b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.803024:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8400 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:2.0:1787786424.803028:0:7633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff29b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.803038:0:7633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff29b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.803057:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8b52100f1b00) 00010000:00010000:2.0:1787786424.803059:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787786424.803065:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff29b4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.803071:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff29b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786424.803094:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786424.803103:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786424.803105:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786424.803111:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52062fc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+20:10565:x1874629667907328:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 Request processed in 4729us (7570us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1787786424.803126:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 32 00000020:00080000:1.0:1787786424.803134:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787786424.827578:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786424.827697:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667907456 00000100:00100000:0.0:1787786424.827710:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667907456 00000100:00100000:0.0:1787786424.828228:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 129 00000100:00100000:0.0:1787786424.828252:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+20:10567:x1874629667907456:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1787786424.828285:0:8713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786424.828314:0:8713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff29bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7523be expref: -99 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.828409:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff29c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.828426:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff29c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.828440:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff29c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.828457:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff29c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.828465:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff29c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.828473:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff29c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.830192:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff29d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.830218:0:8713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff28db lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75237f expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.830229:0:8713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff29d0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.830288:0:8713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff28db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75237f expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786424.830306:0:8713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff28db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75237f expref: 21 pid: 5847 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786424.830504:0:8713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52332c0780 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8713:1874629686789504:192.168.204.34@tcp:104: 00000100:00100000:0.0:1787786424.830663:0:8713:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5210e6b480 going to sleep for 11 seconds 00000100:00100000:2.0:1787786424.833541:0:8713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52332c0780 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8713:1874629686789504:192.168.204.34@tcp:104: 00010000:00010000:2.0:1787786424.833584:0:8713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff29d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786424.833667:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786424.833776:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667907712 00000100:00100000:2.0:1787786424.833787:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667907712 00000100:00100000:2.0:1787786424.833901:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 33 00000100:00100000:2.0:1787786424.833912:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52332c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+22:5618:x1874629667907712:12345-192.168.204.34@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787786424.834472:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52332c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+23:5618:x1874629667907712:12345-192.168.204.34@tcp:35:ldlm_bl.0 Request processed in 558us (803us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1787786424.834482:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 33 00000100:00100000:2.0:1787786424.839933:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786424.840188:0:8508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667907840 00000100:00100000:3.0:1787786424.840202:0:8508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667907840 00010000:00010000:3.0:1787786424.840287:0:8508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff28db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75237f expref: 23 pid: 5847 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786424.840341:0:8508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 60 00000100:00100000:3.0:1787786424.840353:0:8508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5211bfa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:173d08e0-0e54-474e-858e-1679cd38cf14+23:2365:x1874629667907840:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787786424.840373:0:8508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786424.840381:0:8508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff28db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75237f expref: 23 pid: 5847 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.840396:0:8508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff28db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75237f expref: 23 pid: 5847 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.840424:0:8508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff28db lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75237f expref: 23 pid: 5847 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.840443:0:8508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5210c81400) 00010000:00010000:3.0:1787786424.840449:0:8508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff29d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.840460:0:8508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff29d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.840469:0:8508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff29d0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786424.840512:0:8508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787786424.840579:0:8508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5211bfa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:173d08e0-0e54-474e-858e-1679cd38cf14+22:2365:x1874629667907840:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 228us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786424.840587:0:8508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 60 00010000:00010000:1.0:1787786424.840715:0:8713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff29d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.840736:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff29d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787786424.840846:0:8713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787786424.840852:0:8713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787786424.840880:0:8713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff29d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.840895:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff29d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.840907:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff29c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.840914:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff29c2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.840933:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff29c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.840960:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912d400 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786424.840966:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff29c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.840976:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff29c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.840988:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b52100f1600) 00010000:00010000:1.0:1787786424.840991:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787786424.840995:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff29c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.841002:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff29c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.841016:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff29c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.841023:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff29c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.841029:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff29c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.841035:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912c000 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786424.841038:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff29c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.841044:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff29c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.841063:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8b5222ae8600) 00010000:00010000:1.0:1787786424.841066:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787786424.841070:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff29c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.841076:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff29c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.841123:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff29bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523be expref: 22 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.841140:0:8713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff29d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523be expref: 21 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786424.841147:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5210c81400) 00010000:00010000:1.0:1787786424.841150:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787786424.841152:0:8713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912d200, rc 0) 00000100:00100000:1.0:1787786424.841189:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+21:10567:x1874629667907456:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 12951us (13627us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786424.841197:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 129 00000001:00080000:2.0:1787786425.443422:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:2.0:1787786425.443447:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:2.0:1787786425.443455:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:2.0:1787786425.443467:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1787786425.443474:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1787786425.443479:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000040:00080000:0.0:1787786425.781041:0:12065:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787786425.781055:0:12065:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787786425.781107:0:12065:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787786425.781118:0:12065:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787786425.808192:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787786425.810988:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787786425.811003:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787786425.811044:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1787786425.811054:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787786425.811240:0:11693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52332c0f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874629686789632:192.168.204.34@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787786425.811377:0:11693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b4be780 going to sleep for 11 seconds 00000100:00100000:0.0:1787786425.816203:0:11693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52332c0f00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874629686789632:192.168.204.34@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787786425.817163:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786425.817502:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667907968 00000100:00100000:3.0:1787786425.817515:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667907968 00000100:00100000:3.0:1787786425.817646:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 130 00000100:00100000:3.0:1787786425.817659:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52332c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+21:10579:x1874629667907968:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 00000100:00080000:2.0:1787786425.817780:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:3.0:1787786425.817850:0:7644:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787786425.817995:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52332c0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+21:10579:x1874629667907968:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 Request processed in 338us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786425.818004:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 130 00000100:00100000:1.0:1787786425.836587:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786425.836646:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667908224 00000100:00100000:1.0:1787786425.836659:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667908224 00000100:00100000:1.0:1787786425.836744:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 131 00000100:00100000:1.0:1787786425.836757:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b9530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+21:10579:x1874629667908224:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787786425.836786:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786425.836833:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8800/0x450132973bff29d7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7523c5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786425.836991:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff29de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786425.837011:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff29de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786425.837025:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff29de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787786425.837039:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787786425.837211:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8800/0x450132973bff29d7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523c5 expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786425.837245:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff29de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523c5 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786425.837255:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5210c81400) 00010000:00010000:1.0:1787786425.837259:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787786425.837263:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523b4d8600, rc 0) 00000100:00100000:1.0:1787786425.837350:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b9530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+23:10579:x1874629667908224:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 595us (778us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1787786425.837359:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 131 00000100:00100000:3.0:1787786425.844269:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786425.844332:0:11675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667908352 00000100:00100000:3.0:1787786425.844346:0:11675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667908352 00000100:00100000:3.0:1787786425.844422:0:11675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 9 00000100:00100000:3.0:1787786425.844435:0:11675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bfdc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:173d08e0-0e54-474e-858e-1679cd38cf14+23:2362:x1874629667908352:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787786425.844457:0:11675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786425.844492:0:11675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff29de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523c5 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786425.844512:0:11675:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5210c81400) 00010000:00010000:3.0:1787786425.844519:0:11675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787786425.844584:0:11675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bfdc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:173d08e0-0e54-474e-858e-1679cd38cf14+22:2362:x1874629667908352:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 152us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786425.844593:0:11675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 9 00000100:00100000:0.0:1787786425.862830:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786425.862939:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667908608 00000100:00100000:1.0:1787786425.862953:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667908608 00000100:00100000:1.0:1787786425.863041:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 132 00000100:00100000:1.0:1787786425.863054:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52332c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+22:10579:x1874629667908608:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787786425.863158:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8800/0x450132973bff29ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786425.863189:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8800/0x450132973bff29ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786425.863203:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8800/0x450132973bff29ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786425.863482:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8800/0x450132973bff29ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786425.863490:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8800/0x450132973bff29ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786425.863497:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8800/0x450132973bff29ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786425.863503:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8800 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786425.863509:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8800/0x450132973bff29ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786425.863518:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8800/0x450132973bff29ec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786425.863537:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5210c81400) 00010000:00010000:1.0:1787786425.863541:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787786425.863549:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8800/0x450132973bff29ec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786425.863556:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8800/0x450132973bff29ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786425.863927:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52332c2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+23:10579:x1874629667908608:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 873us (1108us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1787786425.863945:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 132 00000040:00080000:0.0:1787786425.866469:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787786425.866480:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787786425.867009:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1787786425.867023:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787786425.873496:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786425.873679:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667908864 00000100:00100000:2.0:1787786425.873692:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667908864 00000100:00100000:2.0:1787786425.873780:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 34 00000100:00100000:2.0:1787786425.873812:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52063530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+23:10579:x1874629667908864:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787786425.874145:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52063530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+24:10579:x1874629667908864:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 Request processed in 354us (665us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1787786425.874169:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 34 00000100:00100000:1.0:1787786426.379131:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5206352940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686789760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787786426.379318:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786426.385345:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686789760 00000100:00100000:2.0:1787786426.385401:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686789760 00000100:00100000:2.0:1787786426.385587:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787786426.385614:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b951e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874629686789760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787786426.385734:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787786426.385962:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b951e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1874629686789760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 355us (6643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786426.385980:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787786426.386461:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5206352940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686789760:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787786426.387273:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787786426.826221:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787786426.890396:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787786426.890406:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787786426.890596:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787786426.890604:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787786427.403097:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52332c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686790144:0@lo:400:kworker.0 00000100:00100000:0.0:1787786427.403174:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786427.403252:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787786427.403274:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52332c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686790272:0@lo:400:kworker.0 00000100:00100000:2.0:1787786427.403384:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52332c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874629686790016:0@lo:400:kworker.0 00000100:00100000:2.0:1787786427.403417:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786427.403438:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52332c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686790528:0@lo:400:kworker.0 00000100:00100000:2.0:1787786427.403460:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786427.403480:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787786427.403485:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52332c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686789888:0@lo:400:kworker.0 00000100:00100000:2.0:1787786427.403529:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786427.403553:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52332c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874629686790400:0@lo:400:kworker.0 00000100:00100000:2.0:1787786427.403576:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786427.403603:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686790144 00000100:00100000:2.0:1787786427.403610:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686790144 00000100:00100000:2.0:1787786427.403661:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686790016 00000100:00100000:2.0:1787786427.403665:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686790016 00000100:00100000:2.0:1787786427.403716:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686790400 00000100:00100000:2.0:1787786427.403719:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686790400 00000100:00100000:2.0:1787786427.403739:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787786427.403747:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52332c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686790144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786427.403816:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52332c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686790144:12345-0@lo:400:kworker.0 Request processed in 69us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786427.403823:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787786427.403841:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787786427.403848:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874629686790016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786427.403880:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874629686790016:12345-0@lo:400:kworker.0 Request processed in 33us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786427.403886:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1787786427.403898:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787786427.403904:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874629686790400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786427.403931:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874629686790400:12345-0@lo:400:kworker.0 Request processed in 27us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786427.403936:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1787786427.403956:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686790528 00000100:00100000:2.0:1787786427.403960:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686790528 00000100:00100000:2.0:1787786427.403986:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787786427.403993:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686790528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786427.404024:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686790528:12345-0@lo:400:kworker.0 Request processed in 31us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786427.404029:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1787786427.404045:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787786427.404050:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787786427.404091:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52332c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874629686790400:0@lo:400:kworker.0 00000100:00100000:2.0:1787786427.404110:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52332c21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874629686790016:0@lo:400:kworker.0 00000100:00100000:2.0:1787786427.404119:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1787786427.404124:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:2.0:1787786427.404145:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b523bfdf480, transno 4294967301 00000004:00080000:2.0:1787786427.404155:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1787786427.404166:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b5206206940, transno 4294967304 00000100:00100000:2.0:1787786427.404171:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52332c1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686790528:0@lo:400:kworker.0 00000100:00100000:1.0:1787786427.404598:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686789888 00000100:00100000:1.0:1787786427.404604:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686789888 00000100:00100000:1.0:1787786427.404647:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1787786427.404655:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3312:x1874629686789888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786427.404708:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3312:x1874629686789888:12345-0@lo:400:kworker.0 Request processed in 55us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786427.404714:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1787786427.407185:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52332c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686789888:0@lo:400:kworker.0 00000100:00100000:0.0:1787786427.407983:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786427.408044:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52332c3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686790144:0@lo:400:kworker.0 00000100:00100000:1.0:1787786427.408204:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686790272 00000100:00100000:1.0:1787786427.408212:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686790272 00000100:00100000:1.0:1787786427.408260:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787786427.408270:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52332c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3313:x1874629686790272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786427.408472:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52332c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3313:x1874629686790272:12345-0@lo:400:kworker.0 Request processed in 202us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786427.408479:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787786427.408644:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52332c3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686790272:0@lo:400:kworker.0 00000040:00080000:3.0:1787786427.573550:0:12116:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787786427.573564:0:12116:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787786427.573610:0:12116:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787786427.573617:0:12116:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787786427.776446:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786427.776529:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667909120 00000100:00100000:1.0:1787786427.776539:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667909120 00000100:00100000:1.0:1787786427.776611:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 133 00000100:00100000:1.0:1787786427.776621:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52332c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+24:10600:x1874629667909120:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:1.0:1787786427.776643:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786427.776665:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff29f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7523cc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787786427.776731:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787786427.777976:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9000/0x450132973bff29fa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786427.777993:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9000/0x450132973bff29fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786427.778007:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9000/0x450132973bff29fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787786427.778019:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787786427.778953:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff29f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523cc expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786427.778973:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9000/0x450132973bff29fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523cc expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786427.778981:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5210c81400) 00010000:00010000:1.0:1787786427.778984:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787786427.778987:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523b4d9000, rc 0) 00000100:00100000:1.0:1787786427.779064:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52332c1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+26:10600:x1874629667909120:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 2443us (2627us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1787786427.779074:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 133 00000100:00100000:3.0:1787786427.786312:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786427.786350:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667909248 00000100:00100000:3.0:1787786427.786361:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667909248 00000100:00100000:3.0:1787786427.786421:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 134 00000100:00100000:3.0:1787786427.786433:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206352940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+26:10600:x1874629667909248:12345-192.168.204.34@tcp:54:lfs.0 00010000:00010000:3.0:1787786427.786509:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2a08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786427.786530:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2a08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786427.786542:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2a08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786427.786571:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2a08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786427.786579:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2a08 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786427.786586:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2a08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786427.786593:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7600 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786427.786597:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2a08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786427.786605:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2a08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786427.786618:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5210c81400) 00010000:00010000:3.0:1787786427.786621:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787786427.786634:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2a08 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786427.786971:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff2a08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786427.787051:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206352940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+26:10600:x1874629667909248:12345-192.168.204.34@tcp:54:lfs.0 Request processed in 620us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786427.787059:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 134 00010000:00010000:2.0:1787786427.850402:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786427.887391:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786427.887927:0:12026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667909376 00000100:00100000:2.0:1787786427.887939:0:12026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667909376 00000100:00080000:0.0:1787786427.888365:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787786427.888477:0:12026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 46 00000100:00100000:3.0:1787786427.888490:0:12026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b951a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:173d08e0-0e54-474e-858e-1679cd38cf14+6:2362:x1874629667909376:12345-192.168.204.34@tcp:101:cat.0 00010000:00010000:3.0:1787786427.888509:0:12026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786427.888532:0:12026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008358bafe/0x450132973bff2a0f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7523d3 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787786427.888562:0:12026:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8f74b7, atime: 0x6a8f74b7, ctime: 0x6a8f74b7, blocks: 0xb 00010000:00010000:3.0:1787786427.888585:0:12026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=354s v=(0 0) 00010000:00010000:3.0:1787786427.888590:0:12026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787786427.888601:0:12026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008358bafe/0x450132973bff2a0f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523d3 expref: 7 pid: 12026 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786427.888620:0:12026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008358bafe/0x450132973bff2a0f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523d3 expref: 7 pid: 12026 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786427.888636:0:12026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb7600, rc 0) 00000100:00100000:3.0:1787786427.888712:0:12026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b951a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:173d08e0-0e54-474e-858e-1679cd38cf14+7:2362:x1874629667909376:12345-192.168.204.34@tcp:101:cat.0 Request processed in 224us (1330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786427.888738:0:12026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 46 00000100:00100000:1.0:1787786427.896391:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786427.896456:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667909504 00000100:00100000:3.0:1787786427.896466:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667909504 00002000:00100000:3.0:1787786427.896519:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8b523b9521c0 x1874629667909504/t0(0) o3->173d08e0-0e54-474e-858e-1679cd38cf14@192.168.204.34@tcp:43/0 lens 488/0 e 0 to 0 dl 1787786438 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787786427.896530:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8b523b9521c0 with x1874629667909504 ext(0->4095) 00002000:00010000:3.0:1787786427.896536:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b523b9521c0 00000100:00100000:3.0:1787786427.896643:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 3 00000100:00100000:3.0:1787786427.896655:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b9521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:173d08e0-0e54-474e-858e-1679cd38cf14+7:2362:x1874629667909504:12345-192.168.204.34@tcp:3:cat.0 00000100:00100000:3.0:1787786427.897083:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b9521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:173d08e0-0e54-474e-858e-1679cd38cf14+7:2362:x1874629667909504:12345-192.168.204.34@tcp:3:cat.0 Request processed in 429us (701us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787786427.897091:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 3 00002000:00100000:3.0:1787786427.897099:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8b523b9521c0 x1874629667909504/t0(0) o3->173d08e0-0e54-474e-858e-1679cd38cf14@192.168.204.34@tcp:43/0 lens 488/4536 e 0 to 0 dl 1787786438 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787786427.897108:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8b523b9521c0 with x1874629667909504 ext(0->4095) 00002000:00010000:3.0:1787786427.897111:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b523b9521c0 00000100:00100000:3.0:1787786427.917351:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787786427.917377:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52328f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686790656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787786427.917518:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786427.917652:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686790656 00000100:00100000:2.0:1787786427.917659:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686790656 00000100:00100000:2.0:1787786427.917710:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787786427.917718:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5233339680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686790656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787786427.917753:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787786427.917818:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5233339680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686790656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786427.917824:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787786427.917980:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52328f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686790656:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787786428.878987:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786429.366064:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786429.366112:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786429.366141:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786429.366179:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786429.366200:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786429.366240:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667910144 00000100:00100000:3.0:1787786429.366250:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667910144 00000100:00100000:3.0:1787786429.366303:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667909760 00000100:00100000:3.0:1787786429.366307:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667909760 00000100:00100000:2.0:1787786429.366318:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667909888 00000100:00100000:2.0:1787786429.366322:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667909888 00000100:00100000:3.0:1787786429.366328:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 127 00000100:00100000:3.0:1787786429.366337:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523333a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e407027-7940-45d9-87d7-56031cd08b7a+5:2362:x1874629667910144:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786429.366347:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667910016 00000100:00100000:2.0:1787786429.366350:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667910016 00000100:00100000:2.0:1787786429.366370:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 71 00000100:00100000:2.0:1787786429.366376:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523333bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:173d08e0-0e54-474e-858e-1679cd38cf14+7:2362:x1874629667909888:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1787786429.366411:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523333a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e407027-7940-45d9-87d7-56031cd08b7a+5:2362:x1874629667910144:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 75us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786429.366464:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667909632 00000100:00100000:0.0:1787786429.366468:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667909632 00000100:00100000:0.0:1787786429.366502:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 283 00000100:00100000:0.0:1787786429.366510:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2362:x1874629667909632:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1787786429.366572:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 127 00000100:00100000:3.0:1787786429.366591:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 128 00000100:00100000:3.0:1787786429.366599:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52088b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+26:2362:x1874629667909760:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786429.369290:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523333bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:173d08e0-0e54-474e-858e-1679cd38cf14+7:2362:x1874629667909888:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 2902us (3166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786429.369300:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2362:x1874629667909632:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 2789us (3245us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786429.369304:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 71 00000100:00100000:0.0:1787786429.369326:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 283 00000100:00080000:0.0:1787786429.369366:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787786429.369370:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787786429.369373:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787786429.369386:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 72 00000100:00100000:2.0:1787786429.369398:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52088b70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:173d08e0-0e54-474e-858e-1679cd38cf14+5:2362:x1874629667910016:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786429.369458:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52088b70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:173d08e0-0e54-474e-858e-1679cd38cf14+5:2362:x1874629667910016:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 64us (3257us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786429.369464:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 72 00000100:00100000:3.0:1787786429.372805:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52088b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+26:2362:x1874629667909760:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 6170us (6587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786429.372823:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 128 00010000:00010000:0.0:1787786429.902388:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787786430.034191:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1787786430.034210:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000020:00080000:0.0:1787786430.042706:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1787786430.042751:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000020:00080000:3.0:1787786430.042765:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:0.0:1787786430.042816:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1787786430.042846:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b52328bd6c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1787786430.042851:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8b52090a7200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b52328bdb40 00000020:00080000:0.0:1787786430.042854:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8b52090a7400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b5233365c00 00000020:00080000:3.0:1787786430.042888:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1787786430.043081:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1787786430.926768:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786431.498350:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52088b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686790784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787786431.498428:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786431.498571:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686790784 00000100:00100000:2.0:1787786431.498580:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686790784 00000100:00100000:2.0:1787786431.498659:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787786431.498669:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bfdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686790784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787786431.498716:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787786431.498770:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bfdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686790784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786431.498778:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1787786431.498963:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787786431.499001:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1787786431.499007:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b52062070c0, transno 4294967310 00000004:00080000:1.0:1787786431.499027:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1787786431.499059:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52088b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686790784:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787786431.947327:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786432.525103:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52328f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686790912:0@lo:400:kworker.0 00000100:00100000:1.0:1787786432.525181:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786432.525286:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686790912 00000100:00100000:3.0:1787786432.525294:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686790912 00000100:00100000:3.0:1787786432.525344:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1787786432.525353:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3311:x1874629686790912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786432.525727:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3311:x1874629686790912:12345-0@lo:400:kworker.0 Request processed in 375us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786432.525737:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1787786432.525831:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52328f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686790912:0@lo:400:kworker.0 00000100:00100000:1.0:1787786432.525848:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787786432.525855:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52328f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874629686791040:0@lo:400:kworker.0 00000100:00100000:1.0:1787786432.525882:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786432.525959:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686791040 00000100:00100000:3.0:1787786432.525970:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686791040 00000100:00100000:3.0:1787786432.526006:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787786432.526013:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874629686791040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786432.526047:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874629686791040:12345-0@lo:400:kworker.0 Request processed in 35us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786432.526053:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787786432.526119:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52328f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874629686791040:0@lo:400:kworker.0 00000100:00100000:1.0:1787786432.526237:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52328f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686791168:0@lo:400:kworker.0 00000100:00100000:1.0:1787786432.526265:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786432.526312:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686791168 00000100:00100000:3.0:1787786432.526316:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686791168 00000100:00100000:3.0:1787786432.526349:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787786432.526354:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686791168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786432.526658:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc98f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686791168:12345-0@lo:400:kworker.0 Request processed in 302us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786432.526665:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1787786432.526712:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52328f30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686791168:0@lo:400:kworker.0 00000100:00100000:1.0:1787786432.526722:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787786432.526727:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52328f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686791296:0@lo:400:kworker.0 00000100:00100000:1.0:1787786432.526753:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787786432.526783:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787786432.526880:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686791296 00000100:00100000:3.0:1787786432.526884:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686791296 00000100:00100000:3.0:1787786432.526913:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787786432.526920:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686791296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786432.526956:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686791296:12345-0@lo:400:kworker.0 Request processed in 37us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786432.526962:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787786432.526984:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52328f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686791296:0@lo:400:kworker.0 00000100:00100000:1.0:1787786432.536382:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52328f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874629686791424:0@lo:400:kworker.0 00000100:00100000:1.0:1787786432.536453:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786432.537388:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686791424 00000100:00100000:0.0:1787786432.537398:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686791424 00000100:00100000:0.0:1787786432.537462:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787786432.537469:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874629686791424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786432.537640:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52328f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686791552:0@lo:400:kworker.0 00000100:00100000:2.0:1787786432.537674:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786432.537709:0:12026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686791552 00000100:00100000:2.0:1787786432.537713:0:12026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686791552 00000100:00100000:2.0:1787786432.537737:0:12026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787786432.537744:0:12026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686791552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786432.537775:0:12026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686791552:12345-0@lo:400:kworker.0 Request processed in 32us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786432.537827:0:12026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787786432.537870:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52328f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686791552:0@lo:400:kworker.0 00000100:00100000:0.0:1787786432.538047:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874629686791424:12345-0@lo:400:kworker.0 Request processed in 577us (1592us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786432.538054:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:0.0:1787786432.538078:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787786432.538082:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787786432.538197:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52328f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874629686791424:0@lo:400:kworker.0 00010000:00010000:1.0:1787786432.971988:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786433.034232:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52328f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686791680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787786433.034305:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786433.034461:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686791680 00000100:00100000:2.0:1787786433.034469:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686791680 00000100:00100000:2.0:1787786433.034519:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787786433.034528:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686791680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787786433.034562:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787786433.034616:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686791680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786433.034624:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787786433.034914:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52328f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686791680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787786433.254645:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786433.254820:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667910272 00000100:00100000:1.0:1787786433.254830:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667910272 00000100:00100000:1.0:1787786433.254906:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 135 00000100:00100000:1.0:1787786433.254917:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52088b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+13:10252:x1874629667910272:12345-192.168.204.34@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787786433.255025:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52088b5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+13:10252:x1874629667910272:12345-192.168.204.34@tcp:60:lhsmtool_posix.0 Request processed in 111us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786433.255033:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 135 00000100:00080000:0.0:1787786433.255597:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787786433.269009:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786433.269328:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667910528 00000100:00100000:3.0:1787786433.269347:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667910528 00000100:00100000:3.0:1787786433.269401:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 35 00000100:00100000:3.0:1787786433.269409:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52332c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+13:10252:x1874629667910528:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787786433.269958:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52332c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+14:10252:x1874629667910528:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 Request processed in 547us (956us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1787786433.269966:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 35 00000100:00100000:2.0:1787786433.701766:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786433.702013:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667910656 00000100:00100000:3.0:1787786433.702024:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667910656 00000100:00100000:3.0:1787786433.702108:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 136 00000100:00100000:3.0:1787786433.702118:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e407027-7940-45d9-87d7-56031cd08b7a+5:11054:x1874629667910656:12345-192.168.204.34@tcp:101:lsof.0 00010000:00010000:3.0:1787786433.702137:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786433.702157:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2a16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7523da expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786433.702222:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff2a1d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786433.702236:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff2a1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786433.702249:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff2a1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787786433.702525:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1787786433.702605:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787786433.702610:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787786433.702712:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff2a1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786433.702739:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2a16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523da expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786433.702755:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff2a1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523da expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786433.702770:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5204e6f000) 00010000:00010000:3.0:1787786433.702773:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787786433.702777:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb7e00, rc 0) 00000100:00100000:3.0:1787786433.702981:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e407027-7940-45d9-87d7-56031cd08b7a+6:11054:x1874629667910656:12345-192.168.204.34@tcp:101:lsof.0 Request processed in 864us (1223us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786433.702988:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 136 00010000:00010000:2.0:1787786433.995528:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786434.486926:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786434.486965:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786434.486991:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786434.487017:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786434.487040:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786434.487075:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667911296 00000100:00100000:1.0:1787786434.487085:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667911296 00000100:00100000:1.0:1787786434.487129:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667910912 00000100:00100000:1.0:1787786434.487131:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667910912 00000100:00100000:1.0:1787786434.487148:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 132 00000100:00100000:1.0:1787786434.487156:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e407027-7940-45d9-87d7-56031cd08b7a+6:2364:x1874629667911296:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1787786434.487240:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e407027-7940-45d9-87d7-56031cd08b7a+6:2364:x1874629667911296:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 84us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786434.487248:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 132 00000100:00100000:1.0:1787786434.487276:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 133 00000100:00100000:1.0:1787786434.487282:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+14:2364:x1874629667910912:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1787786434.487319:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+14:2364:x1874629667910912:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 27us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786434.487325:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 133 00000100:00100000:3.0:1787786434.487408:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667911040 00000100:00100000:3.0:1787786434.487412:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667911040 00000100:00100000:3.0:1787786434.487448:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667911168 00000100:00100000:3.0:1787786434.487451:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667911168 00000100:00100000:3.0:1787786434.487468:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 75 00000100:00100000:3.0:1787786434.487474:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+6:2364:x1874629667911040:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1787786434.487501:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+6:2364:x1874629667911040:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 28us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786434.487507:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 75 00000100:00100000:3.0:1787786434.487517:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 76 00000100:00100000:3.0:1787786434.487522:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+5:2364:x1874629667911168:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1787786434.487540:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c0ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+5:2364:x1874629667911168:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 18us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786434.487545:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 76 00000100:00080000:1.0:1787786434.487601:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787786434.487605:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787786434.487694:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667910784 00000100:00100000:0.0:1787786434.487699:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667910784 00000100:00100000:0.0:1787786434.487731:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 285 00000100:00100000:0.0:1787786434.487738:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2364:x1874629667910784:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1787786434.487762:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2364:x1874629667910784:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 25us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786434.487773:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 285 00010000:00010000:1.0:1787786435.018294:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787786435.189381:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1787786435.189394:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1787786435.189427:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1787786435.189438:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1787786436.042054:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787786436.106310:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787786436.106321:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787786436.106732:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1787786436.106739:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787786436.618182:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b435680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686791808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787786436.618264:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786436.619373:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686791808 00000100:00100000:3.0:1787786436.619451:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686791808 00000100:00100000:3.0:1787786436.619574:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787786436.619585:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103b7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686791808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787786436.619627:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787786436.619707:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103b7a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686791808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (1443us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786436.619714:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787786436.619829:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b435680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686791808:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787786436.619907:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787786437.066197:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786437.642938:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b437840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686791936:0@lo:400:kworker.0 00000100:00100000:2.0:1787786437.643127:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874629686792064:0@lo:400:kworker.0 00000100:00100000:2.0:1787786437.643194:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786437.643241:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786437.643263:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686792576:0@lo:400:kworker.0 00000100:00100000:1.0:1787786437.643278:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874629686792448:0@lo:400:kworker.0 00000100:00100000:2.0:1787786437.643296:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786437.643314:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786437.643345:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b435680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686792192:0@lo:400:kworker.0 00000100:00100000:1.0:1787786437.643362:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686791936 00000100:00100000:2.0:1787786437.643375:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786437.643382:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686791936 00000100:00100000:2.0:1787786437.643399:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787786437.643406:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686792320:0@lo:400:kworker.0 00000100:00100000:2.0:1787786437.643433:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786437.643437:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1787786437.643449:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3311:x1874629686791936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786437.643468:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686792576 00000100:00100000:2.0:1787786437.643473:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686792576 00000100:00100000:1.0:1787786437.643504:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3311:x1874629686791936:12345-0@lo:400:kworker.0 Request processed in 56us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786437.643512:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1787786437.643532:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686792320 00000100:00100000:2.0:1787786437.643537:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686792320 00000100:00100000:1.0:1787786437.643549:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686792064 00000100:00100000:1.0:1787786437.643560:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686792064 00000100:00100000:2.0:1787786437.643565:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787786437.643574:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686792576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786437.643612:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686792576:12345-0@lo:400:kworker.0 Request processed in 40us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786437.643618:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787786437.643632:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787786437.643638:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686792320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786437.643669:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686792320:12345-0@lo:400:kworker.0 Request processed in 31us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786437.643674:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787786437.643830:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686792448 00000100:00100000:3.0:1787786437.643835:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686792448 00000100:00100000:3.0:1787786437.643865:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686792192 00000100:00100000:3.0:1787786437.643868:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686792192 00000100:00100000:3.0:1787786437.643890:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787786437.643898:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103b78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874629686792448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786437.643933:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103b78b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874629686792448:12345-0@lo:400:kworker.0 Request processed in 36us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786437.643939:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787786437.643951:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787786437.643958:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686792192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786437.643985:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686792192:12345-0@lo:400:kworker.0 Request processed in 28us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786437.644002:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787786437.644722:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787786437.644732:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874629686792064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786437.644780:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874629686792064:12345-0@lo:400:kworker.0 Request processed in 50us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786437.644787:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787786437.644827:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc4c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686792320:0@lo:400:kworker.0 00000100:00100000:3.0:1787786437.644841:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b435680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686792192:0@lo:400:kworker.0 00000100:00100000:3.0:1787786437.645026:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b437480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874629686792064:0@lo:400:kworker.0 00000100:00100000:3.0:1787786437.645037:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686792576:0@lo:400:kworker.0 00000100:00100000:3.0:1787786437.645098:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b437840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686791936:0@lo:400:kworker.0 00000100:00100000:3.0:1787786437.645108:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc4e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874629686792448:0@lo:400:kworker.0 00000100:00080000:3.0:1787786437.645130:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787786437.645135:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787786438.090291:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786438.154563:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787786438.154593:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52328f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686792704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787786438.154685:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786438.154770:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686792704 00000100:00100000:2.0:1787786438.154778:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686792704 00000100:00100000:2.0:1787786438.154852:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787786438.154862:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686792704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787786438.154917:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787786438.154975:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686792704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786438.154997:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787786438.155070:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52328f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686792704:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1787786438.868128:0:12318:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 19:20:37 (1787786437) 00010000:00010000:1.0:1787786439.115536:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786439.604986:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786439.605043:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786439.605088:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786439.605150:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667911424 00000100:00100000:3.0:1787786439.605164:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667911424 00000100:00100000:1.0:1787786439.605189:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786439.605245:0:12026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667911680 00000100:00100000:2.0:1787786439.605266:0:12026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667911680 00000100:00100000:2.0:1787786439.605345:0:12026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 79 00000100:00100000:2.0:1787786439.605357:0:12026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:173d08e0-0e54-474e-858e-1679cd38cf14+6:2363:x1874629667911680:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786439.605471:0:12026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:173d08e0-0e54-474e-858e-1679cd38cf14+6:2363:x1874629667911680:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 116us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786439.605479:0:12026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 79 00000100:00080000:2.0:1787786439.605531:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787786439.606322:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 287 00000100:00100000:3.0:1787786439.606335:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2363:x1874629667911424:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1787786439.606368:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786439.606388:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2363:x1874629667911424:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 57us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786439.606396:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 287 00000100:00100000:3.0:1787786439.606450:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667911808 00000100:00100000:3.0:1787786439.606458:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667911808 00000100:00100000:3.0:1787786439.606603:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 80 00000100:00100000:3.0:1787786439.606612:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523289a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+5:2363:x1874629667911808:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1787786439.606691:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523289a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+5:2363:x1874629667911808:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 80us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786439.606698:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 80 00000100:00080000:3.0:1787786439.606716:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787786439.607018:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667911936 00000100:00100000:0.0:1787786439.607025:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667911936 00000100:00100000:0.0:1787786439.607168:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667911552 00000100:00100000:0.0:1787786439.607172:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667911552 00000100:00100000:0.0:1787786439.607198:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 137 00000100:00100000:0.0:1787786439.607207:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e407027-7940-45d9-87d7-56031cd08b7a+6:2363:x1874629667911936:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1787786439.607248:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e407027-7940-45d9-87d7-56031cd08b7a+6:2363:x1874629667911936:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 43us (2160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786439.607255:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 137 00000100:00100000:0.0:1787786439.607271:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 138 00000100:00100000:0.0:1787786439.607278:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+13:2363:x1874629667911552:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1787786439.607302:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+13:2363:x1874629667911552:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 24us (2113us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786439.607308:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 138 00000100:00080000:3.0:1787786439.607364:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787786440.138102:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786440.541393:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786440.542305:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667912192 00000100:00100000:2.0:1787786440.542322:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667912192 00000100:00100000:2.0:1787786440.542461:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 137 00000100:00100000:2.0:1787786440.542473:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5232899680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+13:11319:x1874629667912192:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787786440.542513:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786440.542543:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2a24 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7523e1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786440.542641:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2a2b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786440.542660:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2a2b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786440.542674:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2a2b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786440.542692:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2a32 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786440.542700:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2a32 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786440.542731:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2a32 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786440.543419:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aace00/0x450132973bff2a39 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786440.543434:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aace00/0x450132973bff2a39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786440.543443:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aace00/0x450132973bff2a39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786440.543455:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787786440.543695:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2a2b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786440.543705:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2a2b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786440.543712:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2a2b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786440.543719:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aad800 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786440.543724:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2a2b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786440.543733:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2a2b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786440.543748:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8b5204e6f500) 00010000:00010000:2.0:1787786440.543752:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786440.543764:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2a2b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786440.543771:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2a2b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786440.543852:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2a32 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786440.543860:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2a32 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786440.543866:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2a32 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786440.543872:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aada00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786440.543875:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2a32 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786440.543881:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2a32 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786440.543890:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8b5210c81b00) 00010000:00010000:2.0:1787786440.543893:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786440.543896:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2a32 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786440.543902:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2a32 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786440.544492:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2a24 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523e1 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786440.544528:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aace00/0x450132973bff2a39 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523e1 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786440.544537:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b5210c81800) 00010000:00010000:2.0:1787786440.544539:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786440.544542:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aace00, rc 0) 00000100:00100000:2.0:1787786440.544655:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5232899680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+15:11319:x1874629667912192:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 2182us (3276us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1787786440.544667:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 137 00000100:00100000:1.0:1787786440.560267:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786440.563417:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786440.565761:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667912448 00000100:00100000:0.0:1787786440.565787:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667912448 00000100:00100000:0.0:1787786440.565910:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 138 00000100:00100000:0.0:1787786440.565922:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523289a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+15:11319:x1874629667912448:12345-192.168.204.34@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1787786440.566098:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523289a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+15:11319:x1874629667912448:12345-192.168.204.34@tcp:59:lhsmtool_posix.0 Request processed in 177us (2700us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786440.566106:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 138 00000100:00100000:3.0:1787786440.566833:0:8508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667912320 00000100:00100000:3.0:1787786440.566843:0:8508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667912320 00000100:00100000:2.0:1787786440.567042:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00100000:2.0:1787786440.567055:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523289b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+15:2365:x1874629667912320:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787786440.567073:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787786440.567120:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aace00/0x450132973bff2a39 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523e1 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786440.567144:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b5210c81800) 00010000:00010000:2.0:1787786440.567150:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787786440.567209:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523289b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+14:2365:x1874629667912320:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 157us (6959us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786440.567217:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 10 00010000:00010000:1.0:1787786441.163223:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787786441.226088:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787786441.226099:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787786441.226616:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:3.0:1787786441.226626:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787786441.738776:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52332c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686792832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787786441.738875:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786441.739018:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686792832 00000100:00100000:0.0:1787786441.739034:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686792832 00000100:00100000:0.0:1787786441.739094:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787786441.739104:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686792832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787786441.739142:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787786441.745905:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328992c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686792832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6792us (7019us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786441.745936:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1787786441.745985:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787786441.751484:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52332c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686792832:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787786442.190705:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786442.762022:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52328f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686792960:0@lo:400:kworker.0 00000100:00100000:2.0:1787786442.762051:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52328f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686793216:0@lo:400:kworker.0 00000100:00100000:2.0:1787786442.762099:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786442.762106:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786442.762166:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52328f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874629686793088:0@lo:400:kworker.0 00000100:00100000:2.0:1787786442.763585:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787786442.763604:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52328f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686793344:0@lo:400:kworker.0 00000100:00100000:2.0:1787786442.763660:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786442.763706:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686793216 00000100:00100000:2.0:1787786442.763714:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686793216 00000100:00100000:2.0:1787786442.763769:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787786442.763778:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b522349d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686793216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786442.763938:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b522349d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686793216:12345-0@lo:400:kworker.0 Request processed in 159us (1839us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786442.763946:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787786442.763969:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686793344 00000100:00100000:2.0:1787786442.763972:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686793344 00000100:00100000:2.0:1787786442.763997:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787786442.764003:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b522349e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686793344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786442.764034:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b522349e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686793344:12345-0@lo:400:kworker.0 Request processed in 31us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786442.764040:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787786442.764084:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52328f0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686793344:0@lo:400:kworker.0 00000100:00100000:2.0:1787786442.764097:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52328f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686793216:0@lo:400:kworker.0 00000100:00080000:0.0:1787786442.764907:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787786442.766409:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686792960 00000100:00100000:2.0:1787786442.766422:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686792960 00000100:00100000:2.0:1787786442.766474:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1787786442.766484:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3311:x1874629686792960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786442.766583:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3311:x1874629686792960:12345-0@lo:400:kworker.0 Request processed in 100us (4484us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786442.766591:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1787786442.767926:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52328f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686792960:0@lo:400:kworker.0 00000100:00100000:3.0:1787786442.768075:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874629686793472:0@lo:400:kworker.0 00000100:00100000:3.0:1787786442.768127:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786442.768181:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686793472 00000100:00100000:3.0:1787786442.768187:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686793472 00000100:00100000:3.0:1787786442.768231:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787786442.768238:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874629686793472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786442.768284:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874629686793472:12345-0@lo:400:kworker.0 Request processed in 46us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786442.768290:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:3.0:1787786442.768308:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787786442.768330:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874629686793472:0@lo:400:kworker.0 00000100:00100000:1.0:1787786442.768475:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786442.768522:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686793088 00000100:00100000:3.0:1787786442.768528:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686793088 00000100:00100000:3.0:1787786442.768553:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787786442.768559:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237b52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874629686793088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786442.768591:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237b52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874629686793088:12345-0@lo:400:kworker.0 Request processed in 32us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786442.768596:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787786442.768609:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b522349c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686793600:0@lo:400:kworker.0 00000100:00100000:2.0:1787786442.768719:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786442.768725:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786442.768805:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686793600 00000100:00100000:2.0:1787786442.768816:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686793600 00000100:00100000:2.0:1787786442.768851:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787786442.768859:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237b53840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686793600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786442.768905:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237b53840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686793600:12345-0@lo:400:kworker.0 Request processed in 48us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786442.768912:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1787786442.768929:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787786442.769068:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52328f2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874629686793088:0@lo:400:kworker.0 00000100:00100000:1.0:1787786442.769085:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b522349c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686793600:0@lo:400:kworker.0 00000100:00100000:3.0:1787786442.769106:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667912576 00000100:00100000:3.0:1787786442.769112:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667912576 00000100:00100000:3.0:1787786442.769147:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 139 00000100:00100000:3.0:1787786442.769154:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b522349ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+14:11362:x1874629667912576:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:3.0:1787786442.769176:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786442.769196:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff2a47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7523e8 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.769258:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff2a4e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.769271:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff2a4e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.769284:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff2a4e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.769300:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2a55 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.769306:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.769312:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787786442.769457:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787786442.769670:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff2a4e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.769677:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff2a4e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.769683:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff2a4e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.769689:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7a00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786442.769699:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff2a4e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.769706:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff2a4e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.769719:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5204e6f000) 00010000:00010000:3.0:1787786442.769723:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786442.769727:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff2a4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.769733:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff2a4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.769744:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.769750:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2a55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.769756:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2a55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.769760:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb6200 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786442.769763:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2a55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.769770:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2a55 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.769776:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8b5204e6f100) 00010000:00010000:3.0:1787786442.769778:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786442.769786:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2a55 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.769879:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff2a55 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.769921:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff2a47 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523e8 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.769932:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5204e6f000) 00010000:00010000:3.0:1787786442.769934:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786442.769938:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6a00/0x450132973bff2a47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523e8 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.769946:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb6a00, rc 0) 00000100:00100000:3.0:1787786442.770202:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b522349ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+14:11362:x1874629667912576:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 1047us (1485us total) trans 0 rc 301/301 00000100:00100000:3.0:1787786442.770211:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 139 00000100:00100000:1.0:1787786442.779124:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786442.779173:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667912832 00000100:00100000:3.0:1787786442.779184:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667912832 00000100:00100000:3.0:1787786442.779244:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 140 00000100:00100000:3.0:1787786442.779255:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237b530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+14:11362:x1874629667912832:12345-192.168.204.34@tcp:36:lfs.0 00010000:00010000:3.0:1787786442.779311:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786442.779337:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7800/0x450132973bff23c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752221 expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.779356:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5204e6f000) 00010000:00010000:3.0:1787786442.779361:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787786442.779743:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff2a5c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.779758:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff2a1d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523da expref: 5 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.779765:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff2a5c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.779868:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff2a1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523da expref: 5 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.779883:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff2a1d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523da expref: 5 pid: 5846 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786442.779907:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bc4c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874629686793728:192.168.204.34@tcp:104: 00000100:00100000:3.0:1787786442.780095:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52304e46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787786442.787482:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786442.787553:0:11675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667912960 00000100:00100000:2.0:1787786442.787562:0:11675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667912960 00010000:00010000:2.0:1787786442.787619:0:11675:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff2a1d lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523da expref: 6 pid: 5846 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786442.787656:0:11675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 61 00000100:00100000:2.0:1787786442.787666:0:11675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237b51680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e407027-7940-45d9-87d7-56031cd08b7a+6:2365:x1874629667912960:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787786442.787682:0:11675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787786442.787689:0:11675:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff2a1d lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523da expref: 6 pid: 5846 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786442.787703:0:11675:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff2a1d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523da expref: 6 pid: 5846 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786442.787725:0:11675:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5204e6f000) 00010000:00010000:2.0:1787786442.787731:0:11675:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff2a5c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786442.787741:0:11675:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff2a5c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786442.787761:0:11675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff2a5c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786442.787781:0:11675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787786442.787857:0:11675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237b51680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:6e407027-7940-45d9-87d7-56031cd08b7a+6:2365:x1874629667912960:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 192us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786442.787866:0:11675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 61 00010000:00010000:0.0:1787786442.788161:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff2a1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523da expref: 5 pid: 5846 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786442.788176:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bc4c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1874629686793728:192.168.204.34@tcp:104: 00010000:00010000:0.0:1787786442.788196:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff2a5c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786442.788205:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff2a5c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786442.788211:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff2a5c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786442.788233:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2a63 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786442.788242:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2a63 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786442.788249:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2a63 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787786442.789184:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1787786442.789263:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787786442.789275:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff2a5c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786442.789284:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff2a5c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786442.789291:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff2a5c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786442.789297:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d5800 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786442.789301:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff2a5c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786442.789310:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff2a5c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786442.789322:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5204e6f000) 00010000:00010000:0.0:1787786442.789326:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786442.789331:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff2a5c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786442.789338:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff2a5c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787786442.789355:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d67cea80 reply state 00000000cab9597d transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2a63 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786442.789363:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787786442.789438:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237b530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+15:11362:x1874629667912832:12345-192.168.204.34@tcp:36:lfs.0 Request processed in 10183us (10321us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1787786442.789455:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 140 00010000:00010000:3.0:1787786442.796947:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2a63 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.796976:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2a63 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.796984:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2a63 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.796991:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912da00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786442.796995:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2a63 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.797003:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2a63 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.797039:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8b5222ae8b00) 00010000:00010000:3.0:1787786442.797042:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786442.797047:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2a63 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.797054:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2a63 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786442.897906:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786442.898024:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667913088 00000100:00100000:0.0:1787786442.898035:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667913088 00000100:00100000:0.0:1787786442.898096:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 141 00000100:00100000:0.0:1787786442.898107:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b522349c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+14:11370:x1874629667913088:12345-192.168.204.34@tcp:101:lctl.0 00010000:00010000:0.0:1787786442.898131:0:8713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786442.898154:0:8713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2a6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7523ef expref: -99 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786442.898223:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff2a71 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786442.898237:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff2a71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786442.898248:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff2a71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787786442.898306:0:8713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787786442.898322:0:8713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787786442.898356:0:8713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff2a71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786442.898382:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2a6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523ef expref: 16 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786442.898411:0:8713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff2a71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523ef expref: 15 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786442.898434:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5222ae8100) 00010000:00010000:0.0:1787786442.898438:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787786442.898441:0:8713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912c200, rc 0) 00000100:00100000:0.0:1787786442.898517:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b522349c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+15:11370:x1874629667913088:12345-192.168.204.34@tcp:101:lctl.0 Request processed in 409us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786442.898525:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 141 00000100:00100000:0.0:1787786442.941918:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786442.942059:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667913216 00000100:00100000:3.0:1787786442.942069:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667913216 00000100:00100000:3.0:1787786442.942134:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 142 00000100:00100000:3.0:1787786442.942144:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52332c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+15:11376:x1874629667913216:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:3.0:1787786442.942163:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786442.942183:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2a78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7523f6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.942246:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2a7f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.942261:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2a7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.942272:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2a7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.942285:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2a86 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.942290:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2a86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.942311:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2a86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.942443:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4400/0x450132973bff2a8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.942452:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4400/0x450132973bff2a8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.942458:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4400/0x450132973bff2a8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786442.942489:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787786442.942493:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787786442.942515:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4400/0x450132973bff2a8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.942528:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2a7f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.942534:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2a7f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.942540:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2a7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.942546:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d5c00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786442.942550:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2a7f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.942558:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2a7f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.942577:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5222ae8100) 00010000:00010000:3.0:1787786442.942580:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786442.942584:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2a7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.942590:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2a7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.942604:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2a86 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.942609:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2a86 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.942614:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2a86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.942619:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d4e00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786442.942621:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2a86 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.942690:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2a86 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.942698:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8b5204e6f100) 00010000:00010000:3.0:1787786442.942700:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786442.942703:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2a86 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.942709:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2a86 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.942752:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2a78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523f6 expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.942765:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4400/0x450132973bff2a8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523f6 expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.942780:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b5204e6f400) 00010000:00010000:3.0:1787786442.942782:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787786442.942784:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d4400, rc 0) 00000100:00100000:3.0:1787786442.942997:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52332c0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+16:11376:x1874629667913216:12345-192.168.204.34@tcp:101:bash.0 Request processed in 853us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786442.943005:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 142 00000100:00100000:0.0:1787786442.947313:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786442.948492:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667913472 00000100:00100000:3.0:1787786442.948505:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667913472 00000100:00100000:3.0:1787786442.948573:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 143 00000100:00100000:3.0:1787786442.948583:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52332c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+16:11376:x1874629667913472:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:3.0:1787786442.948600:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786442.948619:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2a94 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7523fd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.948756:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2a9b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.948769:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2a9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.948779:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2a9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.948906:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff2aa2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.948915:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff2aa2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.948922:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff2aa2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787786442.949469:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1787786442.949659:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2aa9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.949670:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.949677:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2aa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.949712:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2a9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.949719:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2a9b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.949725:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2a9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.949731:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d5400 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786442.949735:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2a9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.949756:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2a9b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.949768:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b5204e6f400) 00010000:00010000:3.0:1787786442.949770:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786442.949776:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2a9b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.949782:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2a9b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787786442.949829:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000097c08ae2 reply state 000000001692bb7b transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff2aa2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786442.949839:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787786442.949871:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2a94 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523fd expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.949884:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523fd expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.949904:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6fc00) 00010000:00010000:3.0:1787786442.949906:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787786442.949908:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d4c00, rc 0) 00000100:00100000:3.0:1787786442.949979:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52332c2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+19:11376:x1874629667913472:12345-192.168.204.34@tcp:101:bash.0 Request processed in 1397us (2674us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1787786442.949989:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 143 00000100:00100000:0.0:1787786442.957729:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00010000:00010000:1.0:1787786442.957816:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff2aa2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786442.957830:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff2aa2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786442.957837:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff2aa2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786442.957842:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d4000 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786442.957847:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff2aa2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786442.957855:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff2aa2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786442.957871:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b5204e6fe00) 00010000:00010000:1.0:1787786442.957874:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787786442.957879:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff2aa2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786442.957896:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff2aa2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786442.958151:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667913600 00000100:00100000:3.0:1787786442.958177:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667913600 00000100:00100000:3.0:1787786442.958284:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 47 00000100:00100000:3.0:1787786442.958294:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52332c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+5:2362:x1874629667913600:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:3.0:1787786442.958312:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786442.958330:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098d73665/0x450132973bff2ab7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752404 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787786442.958356:0:6699:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787786442.958384:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=369s v=(0 0) 00010000:00010000:3.0:1787786442.958390:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787786442.958399:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098d73665/0x450132973bff2ab7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752404 expref: 6 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.958417:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000098d73665/0x450132973bff2ab7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752404 expref: 6 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786442.958429:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d4a00, rc 0) 00000100:00100000:3.0:1787786442.958492:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52332c2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+6:2362:x1874629667913600:12345-192.168.204.34@tcp:101:bash.0 Request processed in 199us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786442.958499:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 47 00000100:00080000:1.0:1787786442.960220:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787786442.963088:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786442.963195:0:12026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667913728 00000100:00100000:2.0:1787786442.963204:0:12026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667913728 00000100:00100000:2.0:1787786442.963320:0:12026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 48 00000100:00100000:2.0:1787786442.963331:0:12026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237b521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:173d08e0-0e54-474e-858e-1679cd38cf14+6:11376:x1874629667913728:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:2.0:1787786442.963350:0:12026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786442.963368:0:12026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021cd2b12/0x450132973bff2abe lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75240b expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786442.963395:0:12026:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000098d73665/0x450132973bff2ab7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752404 expref: 7 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786442.963403:0:12026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787786442.963406:0:12026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787786442.963411:0:12026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021cd2b12/0x450132973bff2abe lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75240b expref: 7 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786442.963443:0:12026:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000098d73665/0x450132973bff2ab7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752404 expref: 7 pid: 6699 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786442.963469:0:12026:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000098d73665/0x450132973bff2ab7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752404 expref: 7 pid: 6699 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786442.963484:0:12026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b522349f0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12026:1874629686793856:192.168.204.34@tcp:104: 00000100:00100000:2.0:1787786442.963588:0:12026:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52066b0780 going to sleep for 11 seconds 00000100:00100000:0.0:1787786442.966337:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786442.966904:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667913856 00000100:00100000:1.0:1787786442.966915:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667913856 00010000:00010000:1.0:1787786442.966959:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000098d73665/0x450132973bff2ab7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752404 expref: 8 pid: 6699 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786442.966999:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 62 00000100:00100000:1.0:1787786442.967009:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52332c3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:173d08e0-0e54-474e-858e-1679cd38cf14+8:2365:x1874629667913856:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787786442.967024:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786442.967048:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000098d73665/0x450132973bff2ab7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752404 expref: 8 pid: 6699 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786442.967063:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000098d73665/0x450132973bff2ab7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752404 expref: 8 pid: 6699 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786442.967088:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786442.967092:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786442.967100:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000021cd2b12/0x450132973bff2abe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75240b expref: 8 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786442.967110:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021cd2b12/0x450132973bff2abe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75240b expref: 8 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786442.967147:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000021cd2b12/0x450132973bff2abe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75240b expref: 8 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786442.967161:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5232899a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5831:1874629686793984:192.168.204.34@tcp:105: 00000100:00100000:1.0:1787786442.967266:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b446000 going to sleep for 11 seconds 00010000:00010000:2.0:1787786442.970862:0:12026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098d73665/0x450132973bff2ab7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752404 expref: 8 pid: 6699 timeout: 469 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786442.970900:0:12026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b522349f0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12026:1874629686793856:192.168.204.34@tcp:104: 00010000:00010000:2.0:1787786442.970935:0:12026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000021cd2b12/0x450132973bff2abe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75240b expref: 7 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786442.970949:0:12026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aac600, rc 0) 00000100:00100000:2.0:1787786442.971024:0:12026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237b521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:173d08e0-0e54-474e-858e-1679cd38cf14+7:11376:x1874629667913728:12345-192.168.204.34@tcp:101:bash.0 Request processed in 7696us (7944us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786442.971033:0:12026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 48 00000100:00100000:2.0:1787786442.971760:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5232899a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5831:1874629686793984:192.168.204.34@tcp:105: 00010000:00010000:2.0:1787786442.971774:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787786442.971855:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52332c3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:173d08e0-0e54-474e-858e-1679cd38cf14+6:2365:x1874629667913856:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 4846us (5525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786442.971865:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 62 00000100:00100000:0.0:1787786442.977297:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786442.977393:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667914112 00000100:00100000:2.0:1787786442.977403:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667914112 00000100:00100000:2.0:1787786442.977476:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 36 00000100:00100000:2.0:1787786442.977486:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52332c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+18:11376:x1874629667914112:12345-192.168.204.34@tcp:35:bash.0 00000100:00100000:2.0:1787786442.978455:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52332c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+19:11376:x1874629667914112:12345-192.168.204.34@tcp:35:bash.0 Request processed in 964us (1162us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1787786442.978465:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 36 00000100:00100000:0.0:1787786443.058744:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786443.059593:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667914368 00000100:00100000:2.0:1787786443.059604:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667914368 00000100:00100000:2.0:1787786443.059708:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 144 00000100:00100000:2.0:1787786443.059718:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52062070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+19:11386:x1874629667914368:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:2.0:1787786443.059741:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786443.059764:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff2ac5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752412 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786443.059948:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787786443.060073:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff2ac5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752412 expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.060087:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5222ae8100) 00010000:00010000:2.0:1787786443.060091:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787786443.060106:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff2ac5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752412 expref: 21 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.060120:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aade00, rc 0) 00000100:00100000:2.0:1787786443.060179:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52062070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+20:11386:x1874629667914368:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 463us (1445us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1787786443.060186:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 144 00000100:00100000:1.0:1787786443.062772:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786443.062830:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667914624 00000100:00100000:3.0:1787786443.062840:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667914624 00000100:00100000:3.0:1787786443.062904:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 37 00000100:00100000:3.0:1787786443.062913:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5232899a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+20:11386:x1874629667914624:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:3.0:1787786443.063170:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5232899a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+21:11386:x1874629667914624:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 257us (408us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1787786443.063193:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 37 00000100:00100000:0.0:1787786443.153910:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786443.154360:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667914752 00000100:00100000:1.0:1787786443.154382:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667914752 00000100:00100000:1.0:1787786443.154485:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 145 00000100:00100000:1.0:1787786443.154494:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206206940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+21:11392:x1874629667914752:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:1.0:1787786443.154518:0:7644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786443.154538:0:7644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2ad3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752419 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.154607:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9e00/0x450132973bff2ada lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.154620:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9e00/0x450132973bff2ada lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.154630:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9e00/0x450132973bff2ada lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787786443.154688:0:7644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1787786443.154692:0:7644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787786443.154715:0:7644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9e00/0x450132973bff2ada lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.154742:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2ad3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752419 expref: 23 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.154760:0:7644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9e00/0x450132973bff2ada lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752419 expref: 22 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.154786:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b5204e6f400) 00010000:00010000:1.0:1787786443.154830:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787786443.154835:0:7644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523b4d9e00, rc 0) 00000100:00100000:1.0:1787786443.155166:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206206940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+22:11392:x1874629667914752:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 671us (1266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786443.155175:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 145 00000100:00100000:0.0:1787786443.159691:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786443.159772:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667915008 00000100:00100000:2.0:1787786443.159822:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667915008 00000100:00100000:2.0:1787786443.159893:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 146 00000100:00100000:2.0:1787786443.159903:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206207840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+22:11392:x1874629667915008:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:2.0:1787786443.159924:0:8713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786443.159942:0:8713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff2ae1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752420 expref: -99 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.160297:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff2ae8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.160314:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff2ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.160326:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff2ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786443.160336:0:8713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787786443.160469:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff2ae1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752420 expref: 25 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.160487:0:8713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff2ae8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752420 expref: 24 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.160495:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6fc00) 00010000:00010000:2.0:1787786443.160498:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787786443.160501:0:8713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aadc00, rc 0) 00000100:00100000:2.0:1787786443.160566:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206207840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+24:11392:x1874629667915008:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 664us (884us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1787786443.160573:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 146 00000100:00100000:0.0:1787786443.164648:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786443.164688:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786443.164761:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667915264 00000100:00100000:2.0:1787786443.164770:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667915264 00000100:00100000:2.0:1787786443.164878:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 147 00000100:00100000:2.0:1787786443.164897:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523298a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+24:11392:x1874629667915264:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:2.0:1787786443.164923:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786443.164944:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2af6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752427 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.165059:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2afd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.165074:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2afd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.165086:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2afd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786443.165097:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787786443.165210:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2af6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752427 expref: 27 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.165228:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2afd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752427 expref: 26 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.165236:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6fc00) 00010000:00010000:2.0:1787786443.165239:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787786443.165242:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aacc00, rc 0) 00000100:00100000:2.0:1787786443.165299:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523298a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+26:11392:x1874629667915264:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 404us (660us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1787786443.165323:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 147 00000100:00100000:3.0:1787786443.165498:0:8508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667915392 00000100:00100000:3.0:1787786443.165503:0:8508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667915392 00000100:00100000:3.0:1787786443.165541:0:8508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 11 00000100:00100000:3.0:1787786443.165549:0:8508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523298b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:173d08e0-0e54-474e-858e-1679cd38cf14+26:2364:x1874629667915392:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787786443.165560:0:8508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786443.165573:0:8508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff2ae8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752420 expref: 26 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.165584:0:8508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6fc00) 00010000:00010000:3.0:1787786443.165587:0:8508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787786443.165605:0:8508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523298b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:173d08e0-0e54-474e-858e-1679cd38cf14+25:2364:x1874629667915392:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 58us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786443.165611:0:8508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 11 00000100:00100000:0.0:1787786443.172631:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786443.172714:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667915520 00000100:00100000:2.0:1787786443.172725:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667915520 00000100:00100000:2.0:1787786443.172782:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 49 00000100:00100000:2.0:1787786443.172819:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52329883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+6:2365:x1874629667915520:12345-192.168.204.34@tcp:1:lfs.0 00010000:00010000:2.0:1787786443.172873:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000309a4d86/0x450132973bff2b0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.173069:0:8126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000021cd2b12/0x450132973bff2abe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75240b expref: 6 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.173080:0:8126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787786443.173085:0:8126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787786443.173090:0:8126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000309a4d86/0x450132973bff2b0b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.173125:0:8126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000021cd2b12/0x450132973bff2abe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75240b expref: 6 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.173140:0:8126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000021cd2b12/0x450132973bff2abe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75240b expref: 6 pid: 12026 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786443.173154:0:8126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b522349f0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8126:1874629686794112:192.168.204.34@tcp:104: 00000100:00100000:2.0:1787786443.173237:0:8126:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52066b0780 going to sleep for 11 seconds 00000100:00100000:0.0:1787786443.177172:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786443.177275:0:8126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b522349f0c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8126:1874629686794112:192.168.204.34@tcp:104: 00010000:00010000:2.0:1787786443.177323:0:8126:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000309a4d86/0x450132973bff2b0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786443.177610:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667915648 00000100:00100000:3.0:1787786443.177617:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667915648 00002000:00100000:3.0:1787786443.177669:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8b523298a580 x1874629667915648/t0(0) o4->173d08e0-0e54-474e-858e-1679cd38cf14@192.168.204.34@tcp:59/0 lens 504/0 e 0 to 0 dl 1787786454 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787786443.177679:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8b523298a580 with x1874629667915648 ext(0->12) 00010000:00010000:3.0:1787786443.177686:0:6706:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000021cd2b12/0x450132973bff2abe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75240b expref: 7 pid: 12026 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.177699:0:6706:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000021cd2b12/0x450132973bff2abe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75240b expref: 7 pid: 12026 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787786443.177707:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8b523298a580 00000100:00100000:3.0:1787786443.177945:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 2 00000100:00100000:3.0:1787786443.178228:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523298a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:173d08e0-0e54-474e-858e-1679cd38cf14+7:2365:x1874629667915648:12345-192.168.204.34@tcp:4:lfs.0 00000100:00100000:3.0:1787786443.179243:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523298a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:173d08e0-0e54-474e-858e-1679cd38cf14+9:2365:x1874629667915648:12345-192.168.204.34@tcp:4:lfs.0 Request processed in 1014us (2074us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787786443.179254:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 2 00002000:00100000:3.0:1787786443.179264:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8b523298a580 x1874629667915648/t4294967305(0) o4->173d08e0-0e54-474e-858e-1679cd38cf14@192.168.204.34@tcp:59/0 lens 504/448 e 0 to 0 dl 1787786454 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787786443.179273:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8b523298a580 with x1874629667915648 ext(0->12) 00010000:00010000:3.0:1787786443.179282:0:6706:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000021cd2b12/0x450132973bff2abe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75240b expref: 9 pid: 12026 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.179298:0:6706:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000021cd2b12/0x450132973bff2abe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75240b expref: 9 pid: 12026 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787786443.179305:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8b523298a580 00000100:00100000:0.0:1787786443.182630:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786443.182767:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667915776 00000100:00100000:3.0:1787786443.182777:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667915776 00010000:00010000:3.0:1787786443.182843:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000021cd2b12/0x450132973bff2abe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75240b expref: 9 pid: 12026 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786443.182898:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 63 00000100:00100000:3.0:1787786443.182907:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bef3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:173d08e0-0e54-474e-858e-1679cd38cf14+9:2365:x1874629667915776:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787786443.182923:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787786443.182941:0:5832:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787786443.182944:0:5832:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787786443 00002000:00010000:3.0:1787786443.182952:0:5832:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787786443 00002000:00010000:3.0:1787786443.182954:0:5832:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787786443 00010000:00010000:3.0:1787786443.182960:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000021cd2b12/0x450132973bff2abe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75240b expref: 9 pid: 12026 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.182975:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000021cd2b12/0x450132973bff2abe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75240b expref: 9 pid: 12026 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.183011:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021cd2b12/0x450132973bff2abe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75240b expref: 9 pid: 12026 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.183028:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787786443.183033:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787786443.183038:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000309a4d86/0x450132973bff2b0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.183049:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000309a4d86/0x450132973bff2b0b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.183074:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787786443.183131:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bef3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:173d08e0-0e54-474e-858e-1679cd38cf14+8:2365:x1874629667915776:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 224us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786443.183138:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 63 00010000:00010000:1.0:1787786443.183776:0:8126:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000309a4d86/0x450132973bff2b0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.183819:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000309a4d86/0x450132973bff2b0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.183848:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000309a4d86/0x450132973bff2b0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.183856:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000309a4d86/0x450132973bff2b0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.183874:0:8126:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000309a4d86/0x450132973bff2b0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.183881:0:8126:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aade00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:1.0:1787786443.183893:0:8126:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000309a4d86/0x450132973bff2b0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.183916:0:8126:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000309a4d86/0x450132973bff2b0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.183929:0:8126:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000309a4d86/0x450132973bff2b0b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.183938:0:8126:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000309a4d86/0x450132973bff2b0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786443.184141:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52329883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+7:2365:x1874629667915520:12345-192.168.204.34@tcp:1:lfs.0 Request processed in 11349us (11517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786443.184150:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 49 00000100:00100000:0.0:1787786443.187731:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786443.187840:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667916032 00000100:00100000:3.0:1787786443.187848:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667916032 00000100:00100000:3.0:1787786443.187917:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 38 00000100:00100000:3.0:1787786443.187927:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52062fdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+25:11392:x1874629667916032:12345-192.168.204.34@tcp:35:lfs.0 00000004:00010000:2.0:1787786443.188517:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2afd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752427 expref: 25 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787786443.188824:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1787786443.188895:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1787786443.189768:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1787786443.190240:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2b12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.190260:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2aa9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523fd expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.190270:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2b12 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.190305:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523fd expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.190321:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2aa9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523fd expref: 29 pid: 5846 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786443.190336:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b522349f0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874629686794240:192.168.204.34@tcp:104: 00000100:00100000:2.0:1787786443.190757:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5204d16000 going to sleep for 11 seconds 00000100:00100000:0.0:1787786443.194548:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786443.194686:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b522349f0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874629686794240:192.168.204.34@tcp:104: 00010000:00010000:2.0:1787786443.194718:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2b12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786443.195626:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667916160 00000100:00100000:1.0:1787786443.195637:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667916160 00010000:00010000:1.0:1787786443.195679:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2aa9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523fd expref: 30 pid: 5846 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786443.195765:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 64 00000100:00100000:1.0:1787786443.195775:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5211bfa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:173d08e0-0e54-474e-858e-1679cd38cf14+30:2365:x1874629667916160:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787786443.195811:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786443.195818:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2aa9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523fd expref: 30 pid: 5846 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.195832:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2aa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523fd expref: 30 pid: 5846 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.195870:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2aa9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523fd expref: 30 pid: 5846 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.195898:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6fc00) 00010000:00010000:1.0:1787786443.195903:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2b12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.195912:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2b12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.195919:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2b12 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.195960:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786443.196141:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5211bfa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:173d08e0-0e54-474e-858e-1679cd38cf14+29:2365:x1874629667916160:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 366us (1602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786443.196150:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 64 00010000:00010000:2.0:1787786443.196538:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2b12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.196548:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2b12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787786443.196680:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1787786443.196920:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1787786443.197048:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b522349f0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874629686794368:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787786443.197098:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786443.197133:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5204d169c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787786443.197320:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686794368 00000100:00100000:0.0:1787786443.197327:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686794368 00000100:00100000:0.0:1787786443.197377:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787786443.197387:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b522349c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1874629686794368:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787786443.197460:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b522349c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1874629686794368:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 74us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786443.197479:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787786443.198275:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b522349f0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874629686794368:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787786443.198831:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1787786443.198916:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b522349f0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874629686794496:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787786443.199468:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786443.199703:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b521145fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787786443.200123:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686794496 00000100:00100000:0.0:1787786443.200132:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686794496 00000100:00100000:0.0:1787786443.200214:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787786443.200224:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1874629686794496:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787786443.200448:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5849:x1874629686794496:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 225us (981us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787786443.200457:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787786443.200542:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b522349f0c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874629686794496:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1787786443.200613:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1787786443.200657:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2b12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.200668:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2b12 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.200676:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2b12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.200682:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aac000 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786443.200687:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2b12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.200694:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2b12 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.200712:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6fc00) 00010000:00010000:3.0:1787786443.200715:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1787786443.200720:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2b12 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.200727:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2b12 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787786443.201183:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1787786443.201321:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1787786443.201333:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 369559541866ns, next at 370559539942ns, rc = 0 00000001:00080000:3.0:1787786443.201340:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1787786443.201403:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6fc00) 00010000:00010000:3.0:1787786443.201406:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787786443.201414:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2afd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752427 expref: 33 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786443.201529:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52062fdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+32:11392:x1874629667916032:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 13603us (13807us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1787786443.201537:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 38 00000020:00080000:3.0:1787786443.201542:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787786443.203997:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786443.204176:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667916288 00000100:00100000:3.0:1787786443.204184:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667916288 00000100:00100000:3.0:1787786443.204235:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 148 00000100:00100000:3.0:1787786443.204244:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523289b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+32:11392:x1874629667916288:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:3.0:1787786443.204265:0:7644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786443.204287:0:7644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2b19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75242e expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.204345:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2b19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75242e expref: 33 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.204359:0:7644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2b19 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75242e expref: 33 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.204387:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:3.0:1787786443.204390:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787786443.204394:0:7644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d5600, rc 0) 00000100:00100000:3.0:1787786443.204448:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523289b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+33:11392:x1874629667916288:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 204us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786443.204470:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 148 00000100:00100000:1.0:1787786443.207256:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786443.207558:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667916544 00000100:00100000:0.0:1787786443.207569:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667916544 00000100:00100000:0.0:1787786443.207667:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 39 00000100:00100000:0.0:1787786443.207678:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5232899a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+33:11392:x1874629667916544:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:0.0:1787786443.207945:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5232899a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+34:11392:x1874629667916544:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 268us (696us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1787786443.207954:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 39 00010000:00010000:1.0:1787786443.214904:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786443.276231:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787786443.276257:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52328f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686794624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787786443.276334:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786443.276498:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686794624 00000100:00100000:2.0:1787786443.276505:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686794624 00000100:00100000:2.0:1787786443.276553:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787786443.276564:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bfdc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874629686794624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787786443.276590:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787786443.276645:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bfdc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874629686794624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786443.276652:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787786443.276699:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52328f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686794624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787786443.330148:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786443.330240:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667916800 00000100:00100000:3.0:1787786443.330250:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667916800 00000100:00100000:3.0:1787786443.330312:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 149 00000100:00100000:3.0:1787786443.330322:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237b51680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+34:11402:x1874629667916800:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:3.0:1787786443.330345:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786443.330364:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2b20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752435 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786443.330477:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787786443.330594:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2b20 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752435 expref: 36 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.330608:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5222ae8100) 00010000:00010000:3.0:1787786443.330612:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787786443.330617:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2b20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752435 expref: 36 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.330631:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d5400, rc 0) 00000100:00100000:3.0:1787786443.330697:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237b51680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+35:11402:x1874629667916800:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 376us (558us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1787786443.330705:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 149 00000100:00100000:2.0:1787786443.342036:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786443.342201:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667916928 00000100:00100000:1.0:1787786443.342212:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667916928 00000100:00100000:1.0:1787786443.342265:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 150 00000100:00100000:1.0:1787786443.342274:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+35:11402:x1874629667916928:12345-192.168.204.34@tcp:34:lfs.0 00010000:00010000:1.0:1787786443.342355:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff2b2e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.342381:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff2b2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.342393:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff2b2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.342407:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff2b35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.342415:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff2b35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.342421:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff2b35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.342524:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2b3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.342532:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2b3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.342540:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2b3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787786443.342581:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2b3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.342595:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff2b2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.342611:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff2b2e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.342618:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff2b2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.342624:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8200 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786443.342627:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff2b2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.342635:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff2b2e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.342648:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b5204e6f400) 00010000:00010000:1.0:1787786443.342651:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787786443.342667:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff2b2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.342674:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff2b2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.342688:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff2b35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.342694:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff2b35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.342699:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff2b35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.342704:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d9200 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786443.342715:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff2b35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.342721:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff2b35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.342729:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b52100f1000) 00010000:00010000:1.0:1787786443.342731:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787786443.342734:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff2b35 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.342740:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff2b35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.342754:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2b3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.342760:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2b3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.342766:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2b3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.342771:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d9400 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786443.342774:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2b3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.342780:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2b3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.342787:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:1.0:1787786443.342854:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787786443.342864:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2b3c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786443.342870:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2b3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786443.342951:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+35:11402:x1874629667916928:12345-192.168.204.34@tcp:34:lfs.0 Request processed in 677us (923us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786443.342959:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 150 00000100:00100000:3.0:1787786443.346097:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786443.346238:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667917184 00000100:00100000:2.0:1787786443.346248:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667917184 00000100:00100000:2.0:1787786443.346302:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 40 00000100:00100000:2.0:1787786443.346312:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+35:11402:x1874629667917184:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:2.0:1787786443.346576:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+36:11402:x1874629667917184:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 264us (488us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1787786443.346584:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 40 00000100:00100000:0.0:1787786443.398165:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786443.398414:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667917440 00000100:00100000:2.0:1787786443.398424:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667917440 00000100:00100000:2.0:1787786443.398484:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 151 00000100:00100000:2.0:1787786443.398494:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bef2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+36:11405:x1874629667917440:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:2.0:1787786443.398521:0:8713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786443.398542:0:8713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff2b43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75243c expref: -99 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.398618:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2b4a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.398633:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2b4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.398644:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2b4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.399142:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2b51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.399154:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2b51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.399180:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2b51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.399310:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aace00/0x450132973bff2b58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.399319:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aace00/0x450132973bff2b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.399326:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aace00/0x450132973bff2b58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786443.399337:0:8713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787786443.399484:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2b4a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.399493:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2b4a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.399499:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2b4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.399505:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aada00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786443.399510:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2b4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.399517:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2b4a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.399529:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b5204e6f400) 00010000:00010000:2.0:1787786443.399532:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786443.399544:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2b4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.399550:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2b4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.399562:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2b51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.399568:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2b51 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.399574:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2b51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.399579:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aad600 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786443.399582:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2b51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.399587:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2b51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.399594:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b5210c81b00) 00010000:00010000:2.0:1787786443.399596:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786443.399598:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2b51 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.399603:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2b51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.399642:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff2b43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75243c expref: 39 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.400021:0:8713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aace00/0x450132973bff2b58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75243c expref: 38 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.400029:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:2.0:1787786443.400031:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787786443.400034:0:8713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aace00, rc 0) 00000100:00100000:2.0:1787786443.400099:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bef2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+38:11405:x1874629667917440:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 1607us (1944us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1787786443.400108:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 151 00000100:00100000:3.0:1787786443.406769:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786443.406914:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667917568 00000100:00100000:2.0:1787786443.406924:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667917568 00000100:00100000:2.0:1787786443.407004:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 152 00000100:00100000:2.0:1787786443.407015:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+38:11405:x1874629667917568:12345-192.168.204.34@tcp:54:lfs.0 00010000:00010000:2.0:1787786443.407082:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2b66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.407100:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2b66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.407113:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2b66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.407137:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2b66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.407143:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2b66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.407167:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2b66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.407172:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aad600 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786443.407176:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2b66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.407184:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2b66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.407196:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:2.0:1787786443.407200:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787786443.407204:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2b66 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.407211:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2b66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786443.407280:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+38:11405:x1874629667917568:12345-192.168.204.34@tcp:54:lfs.0 Request processed in 268us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786443.407289:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 152 00000100:00100000:1.0:1787786443.410228:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786443.410682:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667917824 00000100:00100000:2.0:1787786443.410693:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667917824 00000100:00100000:2.0:1787786443.410737:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 41 00000100:00100000:2.0:1787786443.410745:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52332c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+38:11405:x1874629667917824:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:2.0:1787786443.411012:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52332c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+39:11405:x1874629667917824:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 266us (793us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1787786443.411020:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 41 00000100:00100000:0.0:1787786443.690774:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786443.690916:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667918080 00000100:00100000:3.0:1787786443.690926:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667918080 00000100:00100000:3.0:1787786443.690992:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 153 00000100:00100000:3.0:1787786443.691017:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bef1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+39:11436:x1874629667918080:12345-192.168.204.34@tcp:101:cat.0 00010000:00010000:3.0:1787786443.691043:0:7644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786443.691065:0:7644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2b6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752443 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.691171:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2b74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.691186:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2b74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.691201:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2b74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786443.691212:0:7644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787786443.691347:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2b6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752443 expref: 42 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.691365:0:7644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2b74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752443 expref: 41 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.691379:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:3.0:1787786443.691382:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787786443.691385:0:7644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d4e00, rc 0) 00000100:00100000:3.0:1787786443.691439:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bef1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+41:11436:x1874629667918080:12345-192.168.204.34@tcp:101:cat.0 Request processed in 425us (676us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1787786443.691447:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 153 00000100:00100000:3.0:1787786443.696078:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786443.696175:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667918336 00000100:00100000:2.0:1787786443.696186:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667918336 00000100:00100000:2.0:1787786443.696245:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 42 00000100:00100000:2.0:1787786443.696255:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52063530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+41:11436:x1874629667918336:12345-192.168.204.34@tcp:35:cat.0 00000100:00100000:2.0:1787786443.696552:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52063530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+42:11436:x1874629667918336:12345-192.168.204.34@tcp:35:cat.0 Request processed in 298us (485us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1787786443.696561:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 42 00000100:00100000:1.0:1787786443.709142:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786443.710496:0:11675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667918464 00000100:00100000:2.0:1787786443.710510:0:11675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667918464 00000100:00100000:2.0:1787786443.710591:0:11675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00100000:2.0:1787786443.710602:0:11675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52332c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:173d08e0-0e54-474e-858e-1679cd38cf14+42:2365:x1874629667918464:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787786443.710618:0:11675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787786443.710642:0:11675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2b74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752443 expref: 42 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.710662:0:11675:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:2.0:1787786443.710667:0:11675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787786443.710739:0:11675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52332c21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:173d08e0-0e54-474e-858e-1679cd38cf14+41:2365:x1874629667918464:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 139us (1607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786443.710747:0:11675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00100000:1.0:1787786443.757483:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786443.757616:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667918720 00000100:00100000:3.0:1787786443.757642:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667918720 00000100:00100000:3.0:1787786443.757705:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 154 00000100:00100000:3.0:1787786443.757714:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52332c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+41:11442:x1874629667918720:12345-192.168.204.34@tcp:101:dd.0 00010000:00010000:3.0:1787786443.757739:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786443.757742:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787786443.757772:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9e00/0x450132973bff2ada lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752419 expref: 41 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.757818:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b5204e6f400) 00010000:00010000:3.0:1787786443.757823:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787786443.757838:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2b82 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75244a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.757958:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2b89 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.757979:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aace00/0x450132973bff2b58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75243c expref: 41 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.757987:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2b89 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.758020:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aace00/0x450132973bff2b58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75243c expref: 41 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.758033:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aace00/0x450132973bff2b58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75243c expref: 41 pid: 8713 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786443.758047:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874629686794752:192.168.204.34@tcp:104: 00000100:00100000:3.0:1787786443.758158:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5206e3c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787786443.763901:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786443.763990:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667918848 00000100:00100000:2.0:1787786443.763998:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667918848 00010000:00010000:2.0:1787786443.764040:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aace00/0x450132973bff2b58 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75243c expref: 42 pid: 8713 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786443.764084:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 65 00000100:00100000:2.0:1787786443.764093:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+42:2365:x1874629667918848:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787786443.764121:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787786443.764128:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aace00/0x450132973bff2b58 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75243c expref: 42 pid: 8713 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.764141:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aace00/0x450132973bff2b58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75243c expref: 42 pid: 8713 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.764163:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:2.0:1787786443.764168:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2b89 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.764177:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2b89 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.764184:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2b89 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786443.764202:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787786443.764249:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+42:2365:x1874629667918848:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 156us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786443.764256:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 65 00010000:00010000:3.0:1787786443.764430:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aace00/0x450132973bff2b58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75243c expref: 41 pid: 8713 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786443.764446:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360cf00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874629686794752:192.168.204.34@tcp:104: 00010000:00010000:3.0:1787786443.764469:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2b89 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.764478:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2b89 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.764484:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2b89 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786443.764502:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787786443.764650:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2b82 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75244a expref: 42 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.764665:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2b89 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75244a expref: 41 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.764674:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:3.0:1787786443.764676:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787786443.764679:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d5c00, rc 0) 00000100:00100000:3.0:1787786443.764705:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52332c3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+41:11442:x1874629667918720:12345-192.168.204.34@tcp:101:dd.0 Request processed in 6993us (7234us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1787786443.764712:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 154 00000100:00100000:1.0:1787786443.767342:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786443.771199:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667919104 00000100:00100000:3.0:1787786443.771239:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667919104 00000100:00100000:3.0:1787786443.771372:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 155 00000100:00100000:3.0:1787786443.771383:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52332c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+41:11442:x1874629667919104:12345-192.168.204.34@tcp:36:dd.0 00010000:00010000:3.0:1787786443.771657:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2b97 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.771675:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2b97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.771689:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2b97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787786443.771741:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1787786443.771766:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ace8c2f reply state 0000000099ccb2bb transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2b97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786443.771775:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787786443.771912:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52332c3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+44:11442:x1874629667919104:12345-192.168.204.34@tcp:36:dd.0 Request processed in 530us (4580us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1787786443.771920:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 155 00000020:00080000:3.0:1787786443.771925:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787786443.778109:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2b97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.778128:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2b97 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.778135:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2b97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.778141:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d4e00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786443.778147:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2b97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.778167:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2b97 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.778185:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:3.0:1787786443.778187:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786443.778193:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2b97 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786443.778199:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2b97 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786444.017407:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786444.017510:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667919232 00000100:00100000:2.0:1787786444.017522:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667919232 00000100:00100000:2.0:1787786444.017604:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 156 00000100:00100000:2.0:1787786444.017614:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523298b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+43:11456:x1874629667919232:12345-192.168.204.34@tcp:101:stat.0 00010000:00010000:2.0:1787786444.017636:0:8713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786444.017656:0:8713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff2b9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752451 expref: -99 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.017746:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2ba5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.017760:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2ba5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.017771:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2ba5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.017785:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2bac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.017822:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2bac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.017829:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2bac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.017937:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2bb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.017959:0:8713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2b89 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75244a expref: 44 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.017968:0:8713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2bb3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.017999:0:8713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2b89 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75244a expref: 44 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.018024:0:8713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2b89 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75244a expref: 44 pid: 5848 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786444.018038:0:8713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52328f0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8713:1874629686794880:192.168.204.34@tcp:104: 00000100:00100000:2.0:1787786444.018129:0:8713:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b521145fa80 going to sleep for 11 seconds 00000100:00080000:0.0:1787786444.018405:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787786444.021895:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786444.021988:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667919488 00000100:00100000:3.0:1787786444.021998:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667919488 00000100:00100000:3.0:1787786444.022058:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 43 00000100:00100000:3.0:1787786444.022068:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+45:5617:x1874629667919488:12345-192.168.204.34@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787786444.022408:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+46:5617:x1874629667919488:12345-192.168.204.34@tcp:35:ldlm_bl.0 Request processed in 341us (523us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1787786444.022417:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 43 00000100:00100000:2.0:1787786444.023632:0:8713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52328f0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8713:1874629686794880:192.168.204.34@tcp:104: 00010000:00010000:2.0:1787786444.023663:0:8713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2bb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786444.025640:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786444.025827:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667919616 00000100:00100000:2.0:1787786444.025836:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667919616 00010000:00010000:2.0:1787786444.025890:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2b89 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75244a expref: 46 pid: 5848 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786444.025926:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 66 00000100:00100000:2.0:1787786444.025936:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf87c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:173d08e0-0e54-474e-858e-1679cd38cf14+46:2365:x1874629667919616:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787786444.026190:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787786444.026199:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2b89 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75244a expref: 46 pid: 5848 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.026213:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2b89 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75244a expref: 46 pid: 5848 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.026238:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2b89 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75244a expref: 46 pid: 5848 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.026275:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:2.0:1787786444.026281:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2bb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.026290:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.026299:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2bb3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.026333:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787786444.026454:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf87c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:173d08e0-0e54-474e-858e-1679cd38cf14+45:2365:x1874629667919616:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 518us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786444.026462:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 66 00010000:00010000:0.0:1787786444.027135:0:8713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.027147:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787786444.027192:0:8713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787786444.027197:0:8713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787786444.027232:0:8713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.027246:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.027256:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2ba5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.027263:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2ba5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.027270:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2ba5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.027276:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aada00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786444.027280:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2ba5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.027287:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2ba5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.027296:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b5204e6f400) 00010000:00010000:0.0:1787786444.027299:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786444.027303:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2ba5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.027310:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aada00/0x450132973bff2ba5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.027322:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2bac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.027328:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2bac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.027340:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2bac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.027346:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aad800 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786444.027350:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2bac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.027709:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2bac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.027719:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b5210c81b00) 00010000:00010000:0.0:1787786444.027721:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786444.027724:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2bac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.027730:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2bac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.027773:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff2b9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752451 expref: 45 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.027831:0:8713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2bb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752451 expref: 44 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.027841:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:0.0:1787786444.027843:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787786444.027846:0:8713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aad200, rc 0) 00000100:00100000:0.0:1787786444.028144:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523298b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+44:11456:x1874629667919232:12345-192.168.204.34@tcp:101:stat.0 Request processed in 10531us (10747us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786444.028164:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 156 00000100:00100000:1.0:1787786444.092323:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786444.092508:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667919872 00000100:00100000:3.0:1787786444.092518:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667919872 00000100:00100000:3.0:1787786444.092575:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 157 00000100:00100000:3.0:1787786444.092585:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+44:11462:x1874629667919872:12345-192.168.204.34@tcp:36:truncate.0 00010000:00010000:3.0:1787786444.092650:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786444.092676:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2bb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752451 expref: 44 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.092697:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:3.0:1787786444.092710:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787786444.094775:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2bba lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.094823:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2bba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.094834:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2bba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787786444.094918:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1787786444.094944:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002f1b13a4 reply state 00000000f0790bc2 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2bba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786444.094959:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787786444.095098:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+46:11462:x1874629667919872:12345-192.168.204.34@tcp:36:truncate.0 Request processed in 2511us (2782us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1787786444.095126:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 157 00000020:00080000:2.0:1787786444.095141:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787786444.099605:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2bba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.099625:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2bba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.099633:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2bba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.099638:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aad000 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786444.099644:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2bba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.099652:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2bba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.099668:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:0.0:1787786444.099671:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786444.099675:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2bba lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.099681:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2bba lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.234107:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786444.287928:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786444.288127:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667920000 00000100:00100000:3.0:1787786444.288139:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667920000 00000100:00100000:3.0:1787786444.288212:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 158 00000100:00100000:3.0:1787786444.288223:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+45:11476:x1874629667920000:12345-192.168.204.34@tcp:101:stat.0 00010000:00010000:3.0:1787786444.288251:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786444.288276:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2bc1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752458 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.288343:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2bc8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.288368:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2bc8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.288380:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2bc8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.288395:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2bcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.288402:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2bcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.288408:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2bcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.288509:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2bd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.288518:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.288538:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786444.288575:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1787786444.288579:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787786444.288601:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.288616:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2bd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.288624:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2bc8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.288630:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2bc8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.288636:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2bc8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.288641:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d5400 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786444.288645:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2bc8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.288651:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2bc8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.288662:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b5204e6f400) 00010000:00010000:3.0:1787786444.288665:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786444.288669:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2bc8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.288684:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2bc8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.288699:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2bcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.288704:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2bcf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.288709:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2bcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.288713:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d4c00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786444.288716:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2bcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.288721:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2bcf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.288728:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b5204e6fc00) 00010000:00010000:3.0:1787786444.288731:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786444.288733:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2bcf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.288738:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2bcf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.288764:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2bc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752458 expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.288778:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2bd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752458 expref: 46 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.288836:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:3.0:1787786444.288848:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787786444.288851:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d4a00, rc 0) 00000100:00100000:3.0:1787786444.288926:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+46:11476:x1874629667920000:12345-192.168.204.34@tcp:101:stat.0 Request processed in 705us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786444.288935:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 158 00000100:00100000:3.0:1787786444.386730:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786444.386915:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667920256 00000100:00100000:0.0:1787786444.386925:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667920256 00000100:00100000:0.0:1787786444.386983:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 159 00000100:00100000:0.0:1787786444.387002:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+46:11486:x1874629667920256:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1787786444.387022:0:8713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786444.387054:0:8713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d600/0x450132973bff2bdd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75245f expref: -99 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787786444.387162:0:8713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787786444.387293:0:8713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d600/0x450132973bff2bdd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75245f expref: 48 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.387307:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5222ae8100) 00010000:00010000:0.0:1787786444.387310:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787786444.387315:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d600/0x450132973bff2bdd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75245f expref: 48 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.387329:0:8713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912d600, rc 0) 00000100:00100000:0.0:1787786444.387413:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+47:11486:x1874629667920256:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 422us (692us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1787786444.387420:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 159 00000100:00100000:0.0:1787786444.390869:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786444.391123:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667920512 00000100:00100000:3.0:1787786444.391134:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667920512 00000100:00100000:3.0:1787786444.391192:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 44 00000100:00100000:3.0:1787786444.391202:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52062fd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+47:11486:x1874629667920512:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:3.0:1787786444.391497:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52062fd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+48:11486:x1874629667920512:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 294us (647us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1787786444.391504:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 44 00000100:00100000:2.0:1787786444.469628:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786444.469908:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667920768 00000100:00100000:0.0:1787786444.469918:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667920768 00000100:00100000:0.0:1787786444.469989:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 160 00000100:00100000:0.0:1787786444.469999:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+48:11492:x1874629667920768:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:0.0:1787786444.470022:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786444.470042:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d600/0x450132973bff2beb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752466 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.470147:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2bf2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.470161:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2bd6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752458 expref: 49 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.470185:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2bf2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.470218:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2bd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752458 expref: 49 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.470232:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2bd6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752458 expref: 49 pid: 5846 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786444.470246:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bef3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874629686795008:192.168.204.34@tcp:104: 00000100:00100000:0.0:1787786444.470613:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b522cc5be40 going to sleep for 11 seconds 00000100:00100000:1.0:1787786444.474208:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786444.474287:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667920896 00000100:00100000:3.0:1787786444.474297:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667920896 00010000:00010000:3.0:1787786444.474339:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2bd6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752458 expref: 50 pid: 5846 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786444.474390:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 67 00000100:00100000:3.0:1787786444.474400:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:173d08e0-0e54-474e-858e-1679cd38cf14+50:2365:x1874629667920896:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787786444.474415:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786444.474422:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2bd6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752458 expref: 50 pid: 5846 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.474453:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2bd6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752458 expref: 50 pid: 5846 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.474476:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:3.0:1787786444.474481:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2bf2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.474491:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2bf2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.474499:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2bf2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.474518:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787786444.474579:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:173d08e0-0e54-474e-858e-1679cd38cf14+50:2365:x1874629667920896:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 180us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786444.474587:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 67 00010000:00010000:0.0:1787786444.475177:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2bd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752458 expref: 49 pid: 5846 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786444.475196:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bef3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874629686795008:192.168.204.34@tcp:104: 00010000:00010000:0.0:1787786444.475219:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2bf2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.475227:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2bf2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.475233:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2bf2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787786444.475251:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1787786444.475418:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d600/0x450132973bff2beb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752466 expref: 50 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.475447:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2bf2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752466 expref: 49 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.475455:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:0.0:1787786444.475457:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787786444.475463:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912c600, rc 0) 00000100:00100000:0.0:1787786444.475508:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+49:11492:x1874629667920768:12345-192.168.204.34@tcp:101:bash.0 Request processed in 5511us (5890us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1787786444.475515:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 160 00000100:00100000:1.0:1787786444.479257:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786444.479461:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667921152 00000100:00100000:3.0:1787786444.479470:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667921152 00000100:00100000:3.0:1787786444.479528:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 161 00000100:00100000:3.0:1787786444.479538:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+49:11492:x1874629667921152:12345-192.168.204.34@tcp:36:bash.0 00010000:00010000:3.0:1787786444.479832:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2c00 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.479850:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2c00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.479870:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2c00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787786444.479934:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1787786444.480226:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000a6b204b reply state 000000009d8da22c transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2c00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786444.480237:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787786444.480378:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+52:11492:x1874629667921152:12345-192.168.204.34@tcp:36:bash.0 Request processed in 839us (1129us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1787786444.480385:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 161 00000020:00080000:3.0:1787786444.480390:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1787786444.486324:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786444.486421:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667921280 00000100:00100000:2.0:1787786444.486433:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667921280 00000100:00100000:2.0:1787786444.486494:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 162 00000100:00100000:2.0:1787786444.486505:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+52:11492:x1874629667921280:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:2.0:1787786444.486531:0:7644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786444.486551:0:7644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2c07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75246d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.486649:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2c0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.486665:0:7644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2bf2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752466 expref: 53 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.486672:0:7644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2c00 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.486679:0:7644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2c0e lrc: 5/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.486697:0:7644:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2c00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.486721:0:7644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2bf2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752466 expref: 53 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.486746:0:7644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2bf2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752466 expref: 53 pid: 5848 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786444.486760:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52328f0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7644:1874629686795136:192.168.204.34@tcp:104: 00000100:00100000:2.0:1787786444.486887:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b521145fc00 going to sleep for 11 seconds 00010000:00010000:3.0:1787786444.491152:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2c00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.491171:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2c00 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.491180:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2c00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.491185:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d4e00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786444.491191:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2c00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.491198:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2c00 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786444.491405:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52328f0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7644:1874629686795136:192.168.204.34@tcp:104: 00000100:00100000:1.0:1787786444.492431:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00010000:00010000:2.0:1787786444.494202:0:7644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2c0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786444.494373:0:8508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667921408 00000100:00100000:0.0:1787786444.494385:0:8508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667921408 00010000:00010000:0.0:1787786444.494430:0:8508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2bf2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752466 expref: 54 pid: 5848 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786444.494471:0:8508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 68 00000100:00100000:0.0:1787786444.494481:0:8508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:173d08e0-0e54-474e-858e-1679cd38cf14+54:2364:x1874629667921408:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787786444.494497:0:8508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787786444.494505:0:8508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2bf2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752466 expref: 54 pid: 5848 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.494518:0:8508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2bf2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752466 expref: 54 pid: 5848 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.494540:0:8508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2bf2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752466 expref: 54 pid: 5848 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.494575:0:8508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:0.0:1787786444.494580:0:8508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2c0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.494590:0:8508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2c0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.494597:0:8508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2c0e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.494879:0:8508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787786444.494942:0:8508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:173d08e0-0e54-474e-858e-1679cd38cf14+53:2364:x1874629667921408:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 460us (2515us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786444.494965:0:8508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 68 00010000:00010000:3.0:1787786444.496618:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:3.0:1787786444.496627:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786444.496636:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2c00 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.496647:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2c00 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.497151:0:7644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2c0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.497161:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2c0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787786444.497216:0:7644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787786444.497228:0:7644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787786444.497253:0:7644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2c0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.497293:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2c07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75246d expref: 52 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.497310:0:7644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2c0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75246d expref: 51 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.497318:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:1.0:1787786444.497321:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787786444.497324:0:7644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aad200, rc 0) 00000100:00100000:1.0:1787786444.497573:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+51:11492:x1874629667921280:12345-192.168.204.34@tcp:101:bash.0 Request processed in 11068us (11257us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786444.497583:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 162 00000100:00100000:1.0:1787786444.502077:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786444.502166:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667921664 00000100:00100000:0.0:1787786444.502176:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667921664 00000100:00100000:0.0:1787786444.502230:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 45 00000100:00100000:0.0:1787786444.502240:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+51:11492:x1874629667921664:12345-192.168.204.34@tcp:35:bash.0 00000100:00100000:0.0:1787786444.502496:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+52:11492:x1874629667921664:12345-192.168.204.34@tcp:35:bash.0 Request processed in 257us (428us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1787786444.502505:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 45 00000100:00100000:2.0:1787786444.590703:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786444.590831:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667921920 00000100:00100000:0.0:1787786444.590841:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667921920 00000100:00100000:0.0:1787786444.590908:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 163 00000100:00100000:0.0:1787786444.590919:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+52:11502:x1874629667921920:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1787786444.590942:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786444.590987:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2c15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752474 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787786444.591099:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787786444.591219:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2c15 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752474 expref: 54 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.591235:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5222ae8100) 00010000:00010000:0.0:1787786444.591238:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787786444.591243:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2c15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752474 expref: 54 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.591258:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912c600, rc 0) 00000100:00100000:0.0:1787786444.591313:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+53:11502:x1874629667921920:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 396us (619us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1787786444.591320:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 163 00000100:00100000:1.0:1787786444.598011:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786444.598096:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667922048 00000100:00100000:3.0:1787786444.598107:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667922048 00000100:00100000:3.0:1787786444.598166:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 164 00000100:00100000:3.0:1787786444.598176:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+53:11502:x1874629667922048:12345-192.168.204.34@tcp:34:lfs.0 00010000:00010000:3.0:1787786444.598254:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2c23 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.598270:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2c23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.598282:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2c23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.598297:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2c2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.598304:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2c2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.598311:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2c2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.598429:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2c31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.598438:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2c31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.598445:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2c31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787786444.598509:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2c31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.598523:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2c23 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.598530:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2c23 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.598537:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2c23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.598544:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d4e00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786444.598548:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2c23 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.598555:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2c23 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.598568:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b5204e6f400) 00010000:00010000:3.0:1787786444.598570:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786444.598575:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2c23 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.598581:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2c23 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.598595:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2c2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.598602:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2c2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.598614:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2c2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.598619:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d4c00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786444.598622:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2c2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.598628:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2c2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.598636:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b5204e6fc00) 00010000:00010000:3.0:1787786444.598639:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786444.598642:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2c2a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.598648:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2c2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.598661:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2c31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.598667:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2c31 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.598672:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2c31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.598676:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d5400 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786444.598679:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2c31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.598695:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2c31 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.598703:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:3.0:1787786444.598706:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786444.598709:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2c31 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.598716:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2c31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786444.598957:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+53:11502:x1874629667922048:12345-192.168.204.34@tcp:34:lfs.0 Request processed in 780us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786444.598966:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 164 00000100:00100000:1.0:1787786444.603133:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786444.603229:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667922304 00000100:00100000:0.0:1787786444.603239:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667922304 00000100:00100000:0.0:1787786444.603304:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 46 00000100:00100000:0.0:1787786444.603314:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+53:11502:x1874629667922304:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:0.0:1787786444.603586:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+54:11502:x1874629667922304:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 272us (463us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1787786444.603595:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 46 00000100:00100000:2.0:1787786444.637054:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786444.637266:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667922560 00000100:00100000:1.0:1787786444.637275:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667922560 00000100:00100000:1.0:1787786444.637339:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 165 00000100:00100000:1.0:1787786444.637467:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+54:11505:x1874629667922560:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:1.0:1787786444.637490:0:7644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786444.637512:0:7644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8000/0x450132973bff2c38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75247b expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.637589:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff2c3f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.637616:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff2c3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.637627:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff2c3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.637642:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8800/0x450132973bff2c46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.637649:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8800/0x450132973bff2c46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.637655:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8800/0x450132973bff2c46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.637826:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9e00/0x450132973bff2c4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.637836:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9e00/0x450132973bff2c4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.637843:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9e00/0x450132973bff2c4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787786444.637853:0:7644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787786444.638085:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff2c3f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.638093:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff2c3f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.638100:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff2c3f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.638112:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8600 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786444.638117:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff2c3f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.638125:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff2c3f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.638138:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b5204e6f400) 00010000:00010000:1.0:1787786444.638141:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787786444.638145:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff2c3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.638151:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff2c3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.638166:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8800/0x450132973bff2c46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.638172:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8800/0x450132973bff2c46 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.638178:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8800/0x450132973bff2c46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.638183:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8800 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786444.638186:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8800/0x450132973bff2c46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.638192:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8800/0x450132973bff2c46 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.638208:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b52100f1000) 00010000:00010000:1.0:1787786444.638211:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787786444.638214:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8800/0x450132973bff2c46 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.638220:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8800/0x450132973bff2c46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.638259:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8000/0x450132973bff2c38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75247b expref: 57 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.638273:0:7644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9e00/0x450132973bff2c4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75247b expref: 56 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.638280:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:1.0:1787786444.638282:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787786444.638285:0:7644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523b4d9e00, rc 0) 00000100:00100000:1.0:1787786444.638567:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+56:11505:x1874629667922560:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 1217us (1522us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1787786444.638576:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 165 00000100:00100000:0.0:1787786444.646253:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786444.646357:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786444.646481:0:11675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667922816 00000100:00100000:3.0:1787786444.646491:0:11675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667922816 00000100:00100000:3.0:1787786444.646555:0:11675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 13 00000100:00100000:3.0:1787786444.646565:0:11675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bef03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:173d08e0-0e54-474e-858e-1679cd38cf14+56:2364:x1874629667922816:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787786444.646582:0:11675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786444.646609:0:11675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9e00/0x450132973bff2c4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75247b expref: 56 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.646628:0:11675:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:3.0:1787786444.646632:0:11675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787786444.646690:0:11675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bef03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:173d08e0-0e54-474e-858e-1679cd38cf14+55:2364:x1874629667922816:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 127us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786444.646698:0:11675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 13 00000100:00100000:2.0:1787786444.648142:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667922688 00000100:00100000:2.0:1787786444.648153:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667922688 00000100:00100000:2.0:1787786444.648238:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 166 00000100:00100000:2.0:1787786444.648248:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+55:11505:x1874629667922688:12345-192.168.204.34@tcp:54:lfs.0 00010000:00010000:2.0:1787786444.648314:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2c5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.648330:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.648354:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.648380:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2c5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.648402:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2c5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.648409:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2c5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.648415:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aad800 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786444.648419:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2c5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.648426:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2c5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.648437:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:2.0:1787786444.648440:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787786444.648445:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2c5b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.648451:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff2c5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786444.648523:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bef3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+55:11505:x1874629667922688:12345-192.168.204.34@tcp:54:lfs.0 Request processed in 277us (2281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786444.648529:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 166 00000100:00100000:0.0:1787786444.652000:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786444.653892:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667923072 00000100:00100000:1.0:1787786444.653907:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667923072 00000100:00100000:1.0:1787786444.654072:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 47 00000100:00100000:1.0:1787786444.654083:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bef1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+55:11505:x1874629667923072:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:1.0:1787786444.654886:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bef1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+56:11505:x1874629667923072:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 259us (2351us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1787786444.654898:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 47 00000100:00100000:0.0:1787786444.722239:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786444.722306:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786444.722356:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786444.722437:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786444.722466:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667923328 00000100:00100000:0.0:1787786444.722476:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667923328 00000100:00100000:0.0:1787786444.722531:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667923456 00000100:00100000:0.0:1787786444.722534:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667923456 00000100:00100000:0.0:1787786444.722558:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 83 00000100:00100000:0.0:1787786444.722568:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bef12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:173d08e0-0e54-474e-858e-1679cd38cf14+6:2362:x1874629667923328:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1787786444.722649:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bef12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:173d08e0-0e54-474e-858e-1679cd38cf14+6:2362:x1874629667923328:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 82us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786444.722656:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 83 00000100:00100000:0.0:1787786444.722673:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 84 00000100:00100000:0.0:1787786444.722679:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bef30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:173d08e0-0e54-474e-858e-1679cd38cf14+7:2362:x1874629667923456:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1787786444.722704:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bef30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:173d08e0-0e54-474e-858e-1679cd38cf14+7:2362:x1874629667923456:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 25us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786444.722710:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 84 00000100:00080000:0.0:1787786444.722728:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787786444.722731:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787786444.723196:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667923584 00000100:00100000:1.0:1787786444.723202:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667923584 00000100:00100000:1.0:1787786444.723254:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 142 00000100:00100000:1.0:1787786444.723262:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bef2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e407027-7940-45d9-87d7-56031cd08b7a+5:2362:x1874629667923584:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1787786444.723304:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bef2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e407027-7940-45d9-87d7-56031cd08b7a+5:2362:x1874629667923584:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 44us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786444.723311:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 142 00000100:00080000:0.0:1787786444.723685:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787786444.724020:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667923200 00000100:00100000:3.0:1787786444.724027:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667923200 00000100:00100000:0.0:1787786444.729157:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 289 00000100:00100000:0.0:1787786444.729173:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b520668d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2362:x1874629667923200:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1787786444.729273:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b520668d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2362:x1874629667923200:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 104us (6915us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786444.729281:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 289 00000100:00100000:0.0:1787786444.794905:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786444.795080:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667923840 00000100:00100000:1.0:1787786444.795090:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667923840 00000100:00100000:1.0:1787786444.795149:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 167 00000100:00100000:1.0:1787786444.795160:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bef0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+56:11523:x1874629667923840:12345-192.168.204.34@tcp:101:cat.0 00010000:00010000:1.0:1787786444.795185:0:7644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786444.795206:0:7644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff2c62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752482 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.795308:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff2c69 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.795322:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff2c69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.795333:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff2c69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787786444.795359:0:7644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787786444.795491:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff2c62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752482 expref: 59 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.795510:0:7644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff2c69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752482 expref: 58 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.795525:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:1.0:1787786444.795528:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787786444.795531:0:7644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523b4d8200, rc 0) 00000100:00100000:1.0:1787786444.795596:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bef0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+58:11523:x1874629667923840:12345-192.168.204.34@tcp:101:cat.0 Request processed in 438us (700us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1787786444.795603:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 167 00000100:00100000:1.0:1787786444.818972:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786444.819188:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667923968 00000100:00100000:0.0:1787786444.819197:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667923968 00000100:00100000:0.0:1787786444.819260:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 168 00000100:00100000:0.0:1787786444.819269:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+58:11524:x1874629667923968:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1787786444.819294:0:8713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786444.819316:0:8713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2c77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752489 expref: -99 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.819396:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2c7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.819410:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2c7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.819421:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2c7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787786444.819482:0:8713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787786444.819486:0:8713:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787786444.819508:0:8713:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2c7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.819536:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2c77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752489 expref: 60 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.819554:0:8713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2c7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752489 expref: 59 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786444.819562:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b5204e6f400) 00010000:00010000:0.0:1787786444.819565:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787786444.819581:0:8713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912da00, rc 0) 00000100:00100000:0.0:1787786444.819644:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+59:11524:x1874629667923968:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 376us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786444.819651:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 168 00000100:00100000:0.0:1787786444.829985:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786444.830055:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667924352 00000100:00100000:2.0:1787786444.830065:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667924352 00000100:00100000:2.0:1787786444.830111:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 48 00000100:00100000:2.0:1787786444.830120:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bef0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+59:11524:x1874629667924352:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:2.0:1787786444.830433:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bef0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+60:11524:x1874629667924352:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 313us (458us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1787786444.830452:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 48 00000100:00100000:0.0:1787786444.832652:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786444.832758:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667924480 00000100:00100000:2.0:1787786444.832766:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667924480 00000100:00100000:2.0:1787786444.832835:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 14 00000100:00100000:2.0:1787786444.832844:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5211bfb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+60:11524:x1874629667924480:12345-192.168.204.34@tcp:103:lfs.0 00010000:00010000:2.0:1787786444.832871:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787786444.832894:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2c0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75246d expref: 60 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.832913:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff2c69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752482 expref: 59 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.832925:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2b19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75242e expref: 58 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786444.832935:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:2.0:1787786444.832966:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787786444.833019:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5211bfb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+57:11524:x1874629667924480:12345-192.168.204.34@tcp:103:lfs.0 Request processed in 175us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786444.833028:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 14 00000100:00100000:0.0:1787786444.835596:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786444.835692:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667924608 00000100:00100000:1.0:1787786444.835703:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667924608 00000100:00100000:1.0:1787786444.835763:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 169 00000100:00100000:1.0:1787786444.835773:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bef0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+57:11524:x1874629667924608:12345-192.168.204.34@tcp:58:lfs.0 00010000:00010000:1.0:1787786444.835919:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff2c85 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.835936:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff2c85 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786444.835959:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff2c85 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787786444.836154:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1787786444.836229:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bef0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+57:11524:x1874629667924608:12345-192.168.204.34@tcp:58:lfs.0 Request processed in 457us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786444.836237:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 169 00000100:00100000:0.0:1787786444.856232:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786444.856359:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667924736 00000100:00100000:3.0:1787786444.856371:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667924736 00000100:00100000:3.0:1787786444.856427:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 170 00000100:00100000:3.0:1787786444.856436:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bef2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+57:11526:x1874629667924736:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:3.0:1787786444.856455:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786444.856475:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2c8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752490 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.856541:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2c93 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.856554:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2c93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.856565:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2c93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.856578:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2c9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.856585:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2c9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.856591:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2c9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.856696:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff2ca1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.856705:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff2ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.856725:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff2ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786444.856761:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787786444.856765:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787786444.856783:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff2ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.856842:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff2ca1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.856860:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2c93 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.856867:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2c93 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.856874:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2c93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.856880:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d4c00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786444.856884:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2c93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.856892:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2c93 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.856902:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b5204e6f400) 00010000:00010000:3.0:1787786444.856906:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786444.856910:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2c93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.856926:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2c93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.856939:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2c9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.856945:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2c9a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.857630:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2c9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.857637:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d4e00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786444.857641:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2c9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.857648:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2c9a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.857659:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b5204e6f200) 00010000:00010000:3.0:1787786444.857661:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786444.857664:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2c9a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.857670:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2c9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.857710:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2c8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752490 expref: 59 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.857723:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff2ca1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752490 expref: 58 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786444.857739:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b52100f1000) 00010000:00010000:3.0:1787786444.857742:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787786444.857744:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d4000, rc 0) 00000100:00100000:3.0:1787786444.858081:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bef2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+58:11526:x1874629667924736:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 1644us (1857us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786444.858092:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 170 00010000:00010000:1.0:1787786445.258696:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787786445.322235:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787786445.322244:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787786445.322321:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787786445.322330:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787786445.322469:0:11693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bef21c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874629686795264:192.168.204.34@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787786445.322577:0:11693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5207b59780 going to sleep for 11 seconds 00000100:00100000:0.0:1787786445.332346:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786445.332399:0:11693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bef21c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874629686795264:192.168.204.34@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787786445.333097:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667924864 00000100:00100000:1.0:1787786445.333105:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667924864 00000100:00100000:1.0:1787786445.333156:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 171 00000100:00100000:1.0:1787786445.333164:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bef3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+58:11537:x1874629667924864:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787786445.333192:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787786445.333283:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bef3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+58:11537:x1874629667924864:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 Request processed in 120us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786445.333291:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 171 00000100:00100000:0.0:1787786445.343938:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786445.344034:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667924992 00000100:00100000:3.0:1787786445.344045:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667924992 00000100:00100000:3.0:1787786445.344105:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 172 00000100:00100000:3.0:1787786445.344116:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bef21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+58:11537:x1874629667924992:12345-192.168.204.34@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787786445.344192:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2ca8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.344210:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2ca8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.344223:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2ca8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.344240:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2caf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.344247:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2caf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.344254:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2caf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.344301:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2cb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.344308:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.344315:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786445.344350:0:7644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787786445.344354:0:7644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787786445.344367:0:7644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.344378:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2ca8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.344384:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2ca8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.344390:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2ca8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.344395:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d5400 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786445.344398:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2ca8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.344405:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2ca8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.344416:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b5210c81800) 00010000:00010000:3.0:1787786445.344425:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786445.344430:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2ca8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.344437:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2ca8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.344450:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2caf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.344455:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2caf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.344595:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2caf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.344602:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d4e00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786445.344605:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2caf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.344611:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2caf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.344619:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8b5204e6fe00) 00010000:00010000:3.0:1787786445.344621:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786445.344624:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2caf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.344630:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2caf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.344646:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2cb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.344657:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2cb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.344662:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2cb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.344667:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d4c00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786445.344671:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2cb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.344677:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2cb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.344684:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b52100f1000) 00010000:00010000:3.0:1787786445.344686:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786445.344689:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2cb6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.344694:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2cb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786445.344816:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bef21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+58:11537:x1874629667924992:12345-192.168.204.34@tcp:34:lhsmtool_posix.0 Request processed in 700us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786445.344824:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 172 00000100:00100000:3.0:1787786445.362474:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786445.362513:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667925248 00000100:00100000:3.0:1787786445.362524:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667925248 00000100:00100000:3.0:1787786445.362585:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 173 00000100:00100000:3.0:1787786445.362595:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5232899a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+58:11537:x1874629667925248:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787786445.362634:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786445.362657:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff2cbd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752497 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.362783:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2cc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.362819:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.362831:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786445.362857:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787786445.363276:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2cc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.363285:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2cc4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.363292:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2cc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.363297:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d5600 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786445.363302:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2cc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.363310:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2cc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.363323:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b52100f1000) 00010000:00010000:3.0:1787786445.363333:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787786445.363338:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2cc4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.363345:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2cc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.363388:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff2cbd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752497 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.363398:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b5210c81800) 00010000:00010000:3.0:1787786445.363402:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787786445.363406:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff2cbd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752497 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.363415:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d5800, rc 0) 00000100:00100000:3.0:1787786445.363491:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5232899a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+59:11537:x1874629667925248:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 897us (1028us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1787786445.363499:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 173 00000100:00100000:0.0:1787786445.376903:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786445.376970:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667925376 00000100:00100000:0.0:1787786445.376980:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667925376 00000100:00100000:0.0:1787786445.377035:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 174 00000100:00100000:0.0:1787786445.377045:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+59:11537:x1874629667925376:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787786445.377082:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787786445.377199:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+59:11537:x1874629667925376:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 Request processed in 153us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786445.377209:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 174 00000100:00100000:3.0:1787786445.381665:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786445.382384:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667925632 00000100:00100000:0.0:1787786445.382399:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667925632 00000100:00100000:0.0:1787786445.382478:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 175 00000100:00100000:0.0:1787786445.382491:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bc4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+59:11537:x1874629667925632:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787786445.382514:0:7644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786445.382518:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787786445.382550:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2c7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752489 expref: 59 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786445.382572:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b5204e6f400) 00010000:00010000:0.0:1787786445.382579:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787786445.382596:0:7644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2cd2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75249e expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787786445.384991:0:7644:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1787786445.385294:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2cd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786445.385310:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786445.385323:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2cd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786445.385397:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2cd2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75249e expref: 61 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786445.385419:0:7644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2cd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75249e expref: 60 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786445.387023:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8b5222ae8800) 00010000:00010000:0.0:1787786445.387027:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787786445.387032:0:7644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912c000, rc 0) 00000100:00100000:0.0:1787786445.387113:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bc4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+60:11537:x1874629667925632:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 4621us (5456us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1787786445.387122:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 175 00000100:00100000:3.0:1787786445.404664:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786445.404700:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667925888 00000100:00100000:3.0:1787786445.404709:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667925888 00000100:00100000:3.0:1787786445.404769:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 176 00000100:00100000:3.0:1787786445.404781:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52332c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+60:11537:x1874629667925888:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787786445.404877:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786445.404905:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2cd9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75249e expref: 60 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.404936:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8b5222ae8800) 00010000:00010000:3.0:1787786445.404950:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787786445.404975:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff2ce7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.405000:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff2ce7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.405012:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff2ce7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.405030:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2cee lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x7e1b0c7d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.405037:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2cee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x7e1b0c7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.405043:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2cee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x7e1b0c7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.405471:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff2ce7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.405481:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff2ce7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.405488:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff2ce7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.405494:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d5800 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786445.405498:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff2ce7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.405513:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff2ce7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.405524:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b5204e6f400) 00010000:00010000:3.0:1787786445.405527:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786445.405532:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff2ce7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.405538:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff2ce7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.405550:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2cee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x7e1b0c7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.405556:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2cee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7e1b0c7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.405562:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2cee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7e1b0c7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.405568:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d5600 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786445.405570:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2cee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7e1b0c7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.405576:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2cee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x7e1b0c7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.405585:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x7e1b0c7d (ffff8b5204e6fe00) 00010000:00010000:3.0:1787786445.405588:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786445.405591:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2cee lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x7e1b0c7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.405608:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2cee lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x7e1b0c7d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786445.405707:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52332c21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+59:11537:x1874629667925888:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 Request processed in 927us (1052us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787786445.405718:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 176 00000100:00100000:3.0:1787786445.408521:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786445.408558:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667926016 00000100:00100000:3.0:1787786445.408568:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667926016 00000100:00100000:3.0:1787786445.408621:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 177 00000100:00100000:3.0:1787786445.408631:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52332c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+59:11537:x1874629667926016:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787786445.408651:0:8713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786445.408672:0:8713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2cf5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7524a5 expref: -99 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.408711:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2cfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.408725:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2cfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.408737:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2cfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.409297:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2cf5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524a5 expref: 61 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.409317:0:8713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2cfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524a5 expref: 60 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.409604:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8b5204e6f000) 00010000:00010000:3.0:1787786445.409608:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787786445.409668:0:8713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d4e00, rc 0) 00000100:00100000:3.0:1787786445.409741:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52332c0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+60:11537:x1874629667926016:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 1111us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786445.409749:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 177 00000100:00100000:3.0:1787786445.419952:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786445.420303:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667926272 00000100:00100000:1.0:1787786445.420314:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667926272 00000100:00100000:1.0:1787786445.420372:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 178 00000100:00100000:1.0:1787786445.420383:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52063530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+60:11537:x1874629667926272:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787786445.421303:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2d03 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.421326:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2d03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.421340:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2d03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787786445.421753:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1787786445.421765:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 371779974117ns, next at 372779971328ns, rc = 0 00000004:00010000:1.0:1787786445.421911:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005bbdea0e reply state 00000000bea9c2ce transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2d03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786445.421922:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787786445.422049:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52063530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+62:11537:x1874629667926272:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 Request processed in 1663us (2103us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1787786445.422058:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 178 00000001:00080000:1.0:1787786445.422236:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967452 is committed 00000001:00080000:1.0:1787786445.422269:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967455 is committed 00000001:00080000:1.0:1787786445.422278:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000020:00080000:1.0:1787786445.422309:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b521145f600 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1787786445.422314:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8b5206016f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b521145f840 00000020:00080000:1.0:1787786445.422317:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8b5206016400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b523bef8c00 00000004:00080000:1.0:1787786445.422375:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1787786445.422399:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1787786445.422596:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1787786445.422709:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52328f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686795392:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787786445.422766:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786445.422871:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686795392 00000100:00100000:1.0:1787786445.422878:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686795392 00000100:00100000:1.0:1787786445.422926:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787786445.422934:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1874629686795392:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1787786445.422958:0:8126:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:1.0:1787786445.423452:0:8126:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8f74cb, atime: 0x6a8f74cb, ctime: 0x6a8f74cb, blocks: 0x1 00010000:00010000:1.0:1787786445.423517:0:8126:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bac21a1f/0x450132973bff2d0a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.423535:0:8126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=371s v=(0 0) 00010000:00010000:1.0:1787786445.423540:0:8126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786445.423546:0:8126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bac21a1f/0x450132973bff2d0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.423562:0:8126:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bac21a1f/0x450132973bff2d0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.423589:0:8126:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bac21a1f/0x450132973bff2d0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.423596:0:8126:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bac21a1f/0x450132973bff2d0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.423619:0:8126:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787786445.426113:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3314:x1874629686795392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3170us (3336us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787786445.426129:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:1.0:1787786445.426180:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787786445.426190:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bac21a1f/0x450132973bff2d0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.426203:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d9200 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:1.0:1787786445.426274:0:7633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bac21a1f/0x450132973bff2d0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.426286:0:7633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bac21a1f/0x450132973bff2d0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.426309:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bac21a1f/0x450132973bff2d0a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.426317:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bac21a1f/0x450132973bff2d0a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.426353:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786445.426355:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786445.426357:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787786445.426397:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b52328f61c0/2, rc 0, transno 4294967307 00000100:00100000:1.0:1787786445.426404:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52328f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686795392:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787786445.427981:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2d03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786445.427994:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2d03 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786445.428002:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2d03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786445.428023:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8a00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786445.428027:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2d03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786445.428035:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2d03 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786445.428050:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8b5204e6f000) 00010000:00010000:2.0:1787786445.428053:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787786445.428057:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2d03 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786445.428063:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2d03 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787786445.428680:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787786445.429232:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786445.429395:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667926400 00000100:00100000:0.0:1787786445.429405:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667926400 00000100:00100000:0.0:1787786445.429674:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 179 00000100:00100000:0.0:1787786445.429687:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+19:11537:x1874629667926400:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787786445.429715:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786445.429737:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2d11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7524ac expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786445.429837:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2d11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524ac expref: 20 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786445.430389:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2d11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524ac expref: 20 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.434102:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8b5204e6f000) 00010000:00010000:1.0:1787786445.434115:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787786445.434121:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912ce00, rc 0) 00000100:00100000:1.0:1787786445.434215:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+20:11537:x1874629667926400:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 4525us (4981us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786445.434225:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 179 00000100:00100000:1.0:1787786445.439440:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786445.439658:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667926528 00000100:00100000:0.0:1787786445.439668:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667926528 00000100:00100000:0.0:1787786445.439731:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 51 00000100:00100000:0.0:1787786445.439742:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+6:2365:x1874629667926528:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1787786445.440323:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+7:2365:x1874629667926528:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 Request processed in 580us (891us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1787786445.440333:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 51 00000100:00100000:0.0:1787786445.446274:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786445.446345:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667926784 00000100:00100000:2.0:1787786445.446356:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667926784 00000100:00100000:2.0:1787786445.446429:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 49 00000100:00100000:2.0:1787786445.446440:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bef03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+20:11537:x1874629667926784:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787786445.447766:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bef03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+21:11537:x1874629667926784:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 Request processed in 1318us (1493us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787786445.447777:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 49 00000100:00100000:3.0:1787786445.451392:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786445.451565:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667927040 00000100:00100000:0.0:1787786445.451578:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667927040 00000100:00100000:0.0:1787786445.451651:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 180 00000100:00100000:0.0:1787786445.451663:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+21:11537:x1874629667927040:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787786445.451933:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+21:11537:x1874629667927040:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 272us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786445.451941:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 180 00000100:00100000:0.0:1787786445.468278:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786445.468359:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667927168 00000100:00100000:2.0:1787786445.468370:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667927168 00000100:00100000:2.0:1787786445.468432:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 181 00000100:00100000:2.0:1787786445.468443:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bef3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+21:11537:x1874629667927168:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787786445.468467:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786445.468489:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2d18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7524b3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786445.468565:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2d1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786445.468594:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2d1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786445.468607:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2d1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786445.468650:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787786445.468672:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2d1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786445.468698:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad600/0x450132973bff2d18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524b3 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786445.468716:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2d1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524b3 expref: 22 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786445.468725:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8b5204e6f000) 00010000:00010000:2.0:1787786445.468729:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787786445.468732:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aac400, rc 0) 00000100:00100000:2.0:1787786445.468824:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bef3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+22:11537:x1874629667927168:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 383us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786445.468833:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 181 00000100:00100000:0.0:1787786445.471978:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786445.472049:0:12026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667927296 00000100:00100000:2.0:1787786445.472059:0:12026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667927296 00000100:00100000:2.0:1787786445.472127:0:12026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 52 00000100:00100000:2.0:1787786445.472139:0:12026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b51032912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:173d08e0-0e54-474e-858e-1679cd38cf14+7:2364:x1874629667927296:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787786445.472158:0:12026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786445.472187:0:12026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a08e598/0x450132973bff2d26 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7524ba expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787786445.472214:0:12026:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f74cd, blocks: 0x1 00010000:00010000:2.0:1787786445.472234:0:12026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=371s v=(0 0) 00010000:00010000:2.0:1787786445.472238:0:12026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787786445.472248:0:12026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a08e598/0x450132973bff2d26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524ba expref: 8 pid: 12026 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786445.472266:0:12026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000009a08e598/0x450132973bff2d26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524ba expref: 8 pid: 12026 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786445.472278:0:12026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aacc00, rc 0) 00000100:00100000:2.0:1787786445.472350:0:12026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b51032912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:173d08e0-0e54-474e-858e-1679cd38cf14+8:2364:x1874629667927296:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 213us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786445.472358:0:12026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 52 00000100:00100000:0.0:1787786445.475356:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786445.475467:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667927552 00000100:00100000:3.0:1787786445.475476:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667927552 00000100:00100000:3.0:1787786445.475542:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 182 00000100:00100000:3.0:1787786445.475553:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103292d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+22:11537:x1874629667927552:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787786445.475673:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103292d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+22:11537:x1874629667927552:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 122us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786445.475681:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 182 00000100:00100000:0.0:1787786445.481257:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786445.481343:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667927680 00000100:00100000:2.0:1787786445.481353:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667927680 00000100:00100000:2.0:1787786445.481411:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 53 00000100:00100000:2.0:1787786445.481421:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b51032930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:173d08e0-0e54-474e-858e-1679cd38cf14+8:11537:x1874629667927680:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787786445.481440:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786445.481458:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e70066b7/0x450132973bff2d2d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7524c1 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786445.481489:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009a08e598/0x450132973bff2d26 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524ba expref: 9 pid: 12026 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786445.481514:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787786445.481518:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787786445.481525:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e70066b7/0x450132973bff2d2d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524c1 expref: 9 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786445.481562:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009a08e598/0x450132973bff2d26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524ba expref: 9 pid: 12026 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786445.481576:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009a08e598/0x450132973bff2d26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524ba expref: 9 pid: 12026 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786445.481591:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237a35a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6700:1874629686795520:192.168.204.34@tcp:104: 00000100:00100000:2.0:1787786445.481688:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b521145fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787786445.494505:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786445.494573:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237a35a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6700:1874629686795520:192.168.204.34@tcp:104: 00010000:00010000:2.0:1787786445.494608:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e70066b7/0x450132973bff2d2d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524c1 expref: 9 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786445.494630:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aad600, rc 0) 00000100:00100000:1.0:1787786445.494735:0:8508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667927808 00000100:00100000:1.0:1787786445.494743:0:8508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667927808 00010000:00010000:1.0:1787786445.494784:0:8508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009a08e598/0x450132973bff2d26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524ba expref: 10 pid: 12026 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786445.494871:0:8508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 69 00000100:00100000:1.0:1787786445.494882:0:8508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b510331da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:173d08e0-0e54-474e-858e-1679cd38cf14+10:2365:x1874629667927808:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787786445.494898:0:8508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786445.494921:0:8508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009a08e598/0x450132973bff2d26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524ba expref: 10 pid: 12026 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.494939:0:8508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009a08e598/0x450132973bff2d26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524ba expref: 10 pid: 12026 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.494972:0:8508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a08e598/0x450132973bff2d26 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524ba expref: 10 pid: 12026 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.494985:0:8508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786445.494990:0:8508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786445.494998:0:8508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e70066b7/0x450132973bff2d2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524c1 expref: 9 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.495007:0:8508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e70066b7/0x450132973bff2d2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524c1 expref: 9 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.495042:0:8508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e70066b7/0x450132973bff2d2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524c1 expref: 9 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786445.495057:0:8508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52328f5a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8508:1874629686795648:192.168.204.34@tcp:105: 00000100:00100000:2.0:1787786445.496165:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b51032930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:173d08e0-0e54-474e-858e-1679cd38cf14+9:11537:x1874629667927680:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 14740us (14914us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786445.496177:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 53 00000100:00100000:1.0:1787786445.496241:0:8508:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b4be180 going to sleep for 11 seconds 00000100:00100000:0.0:1787786445.505153:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786445.505245:0:6705:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667927936 00000100:00100000:2.0:1787786445.505261:0:6705:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667927936 00002000:00100000:2.0:1787786445.505312:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8b5103290780 x1874629667927936/t0(0) o4->173d08e0-0e54-474e-858e-1679cd38cf14@192.168.204.34@tcp:61/0 lens 504/0 e 0 to 0 dl 1787786456 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787786445.505338:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8b5103290780 with x1874629667927936 ext(0->8) 00002000:00010000:2.0:1787786445.505344:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b5103290780 00000100:00100000:2.0:1787786445.505378:0:6705:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 4 00000100:00100000:2.0:1787786445.505387:0:6705:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103290780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:173d08e0-0e54-474e-858e-1679cd38cf14+9:2364:x1874629667927936:12345-192.168.204.34@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1787786445.505870:0:6705:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103290780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:173d08e0-0e54-474e-858e-1679cd38cf14+11:2364:x1874629667927936:12345-192.168.204.34@tcp:4:lhsmtool_posix.0 Request processed in 482us (725us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787786445.505879:0:6705:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 4 00002000:00100000:2.0:1787786445.505887:0:6705:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8b5103290780 x1874629667927936/t4294967314(0) o4->173d08e0-0e54-474e-858e-1679cd38cf14@192.168.204.34@tcp:61/0 lens 504/448 e 0 to 0 dl 1787786456 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787786445.505896:0:6705:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8b5103290780 with x1874629667927936 ext(0->8) 00002000:00010000:2.0:1787786445.505900:0:6705:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b5103290780 00000100:00100000:1.0:1787786445.508537:0:8508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52328f5a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8508:1874629686795648:192.168.204.34@tcp:105: 00010000:00010000:1.0:1787786445.508565:0:8508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786445.508622:0:8508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b510331da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:173d08e0-0e54-474e-858e-1679cd38cf14+10:2365:x1874629667927808:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 13741us (14126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786445.508632:0:8508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 69 00000100:00100000:0.0:1787786445.511488:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786445.511524:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667928064 00000100:00100000:0.0:1787786445.511533:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667928064 00000100:00100000:0.0:1787786445.511584:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 183 00000100:00100000:0.0:1787786445.511594:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103290b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+22:11537:x1874629667928064:12345-192.168.204.34@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787786445.546259:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000020:00080000:2.0:1787786445.546281:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:2.0:1787786445.546293:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:2.0:1787786445.546297:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:2.0:1787786445.546307:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:2.0:1787786445.546388:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1787786445.546398:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1787786445.546832:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b510331c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686795776:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787786445.547178:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786445.547180:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103290b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+18:11537:x1874629667928064:12345-192.168.204.34@tcp:44:lhsmtool_posix.0 Request processed in 35580us (35694us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786445.547195:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 183 00000100:00100000:0.0:1787786445.547239:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686795776 00000100:00100000:0.0:1787786445.547262:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686795776 00000100:00100000:0.0:1787786445.547316:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787786445.547327:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b510331f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686795776:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787786445.547502:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787786445.547506:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787786445 00002000:00010000:0.0:1787786445.547509:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787786445.547511:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787786445 -> 1787786445 00002000:00010000:0.0:1787786445.547513:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787786445.547559:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b510331f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1874629686795776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 235us (387us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787786445.547564:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1787786445.547582:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1787786445.548419:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b510331c000/2, rc 0, transno 4294967315 00000100:00100000:1.0:1787786445.548429:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b510331c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686795776:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1787786445.550592:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786445.550707:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667928192 00000100:00100000:3.0:1787786445.550717:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667928192 00000100:00100000:3.0:1787786445.550869:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 55 00000100:00100000:3.0:1787786445.550880:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+10:2365:x1874629667928192:12345-192.168.204.34@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787786445.587210:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+10:2365:x1874629667928192:12345-192.168.204.34@tcp:16:lhsmtool_posix.0 Request processed in 36322us (36616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786445.587235:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 55 00000001:00080000:3.0:1787786445.587278:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:3.0:1787786445.587288:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:3.0:1787786445.587293:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:1.0:1787786445.604412:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786445.604483:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667928448 00000100:00100000:3.0:1787786445.604492:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667928448 00000100:00100000:3.0:1787786445.604553:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 184 00000100:00100000:3.0:1787786445.604564:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+18:11537:x1874629667928448:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787786445.604626:0:8713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786445.604657:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2d1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524b3 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.604676:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8b5204e6f000) 00010000:00010000:3.0:1787786445.604681:0:8713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787786445.604711:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2d34 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.604726:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2d34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.604735:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2d34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787786445.605315:0:8713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d4ce9dd reply state 0000000014c59744 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2d34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786445.605326:0:8713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787786445.605434:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+19:11537:x1874629667928448:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 Request processed in 871us (1032us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1787786445.605451:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 184 00010000:00010000:3.0:1787786445.611505:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2d34 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.611524:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2d34 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.611532:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2d34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.611539:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d4c00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786445.611544:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2d34 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.611551:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2d34 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.611569:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8b5204e6f000) 00010000:00010000:3.0:1787786445.611572:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786445.611576:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2d34 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.611584:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2d34 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786445.613107:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786445.613215:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667928576 00000100:00100000:2.0:1787786445.613225:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667928576 00000100:00100000:2.0:1787786445.613274:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 56 00000100:00100000:2.0:1787786445.613291:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:173d08e0-0e54-474e-858e-1679cd38cf14+7:2365:x1874629667928576:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787786445.615009:0:6700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1787786445.615017:0:6700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787786445 -> 1787786444 00002000:00010000:2.0:1787786445.615020:0:6700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787786443 00002000:00010000:2.0:1787786445.615023:0:6700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787786445 -> 1787786444 00002000:00010000:2.0:1787786445.615025:0:6700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787786445.615101:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:173d08e0-0e54-474e-858e-1679cd38cf14+8:2365:x1874629667928576:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 Request processed in 1807us (1997us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1787786445.615112:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 56 00000100:00100000:1.0:1787786445.621346:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786445.621427:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667928832 00000100:00100000:0.0:1787786445.621437:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667928832 00000100:00100000:0.0:1787786445.621503:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 185 00000100:00100000:0.0:1787786445.621514:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+18:11537:x1874629667928832:12345-192.168.204.34@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787786445.621598:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2d3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786445.621618:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2cfc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524a5 expref: 18 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786445.621628:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2d3b lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786445.621663:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2cfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524a5 expref: 18 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786445.621678:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2cfc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524a5 expref: 18 pid: 8713 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786445.621702:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103290f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874629686795904:192.168.204.34@tcp:104: 00000100:00100000:0.0:1787786445.621813:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5207b59000 going to sleep for 11 seconds 00000100:00100000:0.0:1787786445.628877:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103290f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874629686795904:192.168.204.34@tcp:104: 00010000:00010000:0.0:1787786445.628912:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2d3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786445.630321:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786445.631127:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667928960 00000100:00100000:3.0:1787786445.631137:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667928960 00010000:00010000:3.0:1787786445.631178:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2cfc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524a5 expref: 19 pid: 8713 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786445.631225:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 70 00000100:00100000:3.0:1787786445.631241:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b510331c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:173d08e0-0e54-474e-858e-1679cd38cf14+19:2364:x1874629667928960:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787786445.631255:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786445.631261:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2cfc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524a5 expref: 19 pid: 8713 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.631273:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2cfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524a5 expref: 19 pid: 8713 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.631294:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2cfc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524a5 expref: 19 pid: 8713 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.631307:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8b5204e6f000) 00010000:00010000:3.0:1787786445.631313:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2d3b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.631323:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2d3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.631330:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2d3b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.631362:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787786445.631428:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b510331c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:173d08e0-0e54-474e-858e-1679cd38cf14+18:2364:x1874629667928960:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 188us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786445.631436:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 70 00010000:00010000:0.0:1787786445.631499:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2d3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786445.631508:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2d3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786445.631537:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2d3b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786445.631543:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2d3b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786445.631549:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2d3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786445.631555:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912da00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786445.631559:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2d3b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786445.631567:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2d3b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786445.631577:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8b5204e6f000) 00010000:00010000:0.0:1787786445.631586:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787786445.631590:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2d3b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786445.631597:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2d3b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786445.631656:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+17:11537:x1874629667928832:12345-192.168.204.34@tcp:55:lhsmtool_posix.0 Request processed in 10144us (10326us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787786445.631665:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 185 00000100:00100000:2.0:1787786445.645756:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786445.646113:0:12026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667929088 00000100:00100000:0.0:1787786445.646197:0:12026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667929088 00000100:00100000:0.0:1787786445.646291:0:12026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 57 00000100:00100000:0.0:1787786445.646304:0:12026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b510331de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:173d08e0-0e54-474e-858e-1679cd38cf14+8:2365:x1874629667929088:12345-192.168.204.34@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787786445.646349:0:12026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b874d3f2/0x450132973bff2d42 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786445.646370:0:12026:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e70066b7/0x450132973bff2d2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524c1 expref: 8 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786445.646379:0:12026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787786445.646384:0:12026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787786445.646388:0:12026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b874d3f2/0x450132973bff2d42 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786445.646436:0:12026:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e70066b7/0x450132973bff2d2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524c1 expref: 8 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786445.646463:0:12026:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e70066b7/0x450132973bff2d2d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524c1 expref: 8 pid: 6700 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786445.646480:0:12026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103290f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12026:1874629686796032:192.168.204.34@tcp:104: 00000100:00100000:0.0:1787786445.646563:0:12026:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5207b59000 going to sleep for 11 seconds 00000040:00080000:1.0:1787786445.653177:0:12471:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787786445.653187:0:12471:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787786445.653234:0:12471:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787786445.653240:0:12471:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787786445.655954:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786445.656005:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667929216 00000100:00100000:1.0:1787786445.656014:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667929216 00010000:00010000:1.0:1787786445.656053:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e70066b7/0x450132973bff2d2d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524c1 expref: 9 pid: 6700 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786445.656092:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 71 00000100:00100000:1.0:1787786445.656102:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:173d08e0-0e54-474e-858e-1679cd38cf14+9:2365:x1874629667929216:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787786445.656117:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786445.656140:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e70066b7/0x450132973bff2d2d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524c1 expref: 9 pid: 6700 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.656155:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e70066b7/0x450132973bff2d2d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524c1 expref: 9 pid: 6700 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.656183:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787786445.656189:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787786445.656195:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b874d3f2/0x450132973bff2d42 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.656205:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b874d3f2/0x450132973bff2d42 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.656237:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786445.656299:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:173d08e0-0e54-474e-858e-1679cd38cf14+9:2365:x1874629667929216:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 198us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786445.656306:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 71 00010000:00010000:0.0:1787786445.656723:0:12026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e70066b7/0x450132973bff2d2d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524c1 expref: 8 pid: 6700 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786445.656739:0:12026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103290f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12026:1874629686796032:192.168.204.34@tcp:104: 00010000:00010000:0.0:1787786445.656763:0:12026:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b874d3f2/0x450132973bff2d42 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.656953:0:12026:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b874d3f2/0x450132973bff2d42 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.656975:0:12026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b874d3f2/0x450132973bff2d42 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.657001:0:12026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b874d3f2/0x450132973bff2d42 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.657009:0:12026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b874d3f2/0x450132973bff2d42 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.657017:0:12026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b874d3f2/0x450132973bff2d42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.657024:0:12026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912da00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:1.0:1787786445.657028:0:12026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b874d3f2/0x450132973bff2d42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.657036:0:12026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b874d3f2/0x450132973bff2d42 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.657061:0:12026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b874d3f2/0x450132973bff2d42 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.657069:0:12026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b874d3f2/0x450132973bff2d42 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786445.657115:0:12026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b510331de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:173d08e0-0e54-474e-858e-1679cd38cf14+7:2365:x1874629667929088:12345-192.168.204.34@tcp:1:lhsmtool_posix.0 Request processed in 10815us (11370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786445.657123:0:12026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 57 00000100:00100000:3.0:1787786445.665722:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786445.665830:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667929472 00000100:00100000:0.0:1787786445.665856:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667929472 00000100:00100000:0.0:1787786445.665924:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 186 00000100:00100000:0.0:1787786445.665935:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b437840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+17:11537:x1874629667929472:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787786445.666040:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2d49 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786445.666060:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2d49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786445.666073:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2d49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786445.666340:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2d50 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786445.666351:0:7644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2d11 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524ac expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786445.666359:0:7644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2d50 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786445.666401:0:7644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2d11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524ac expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786445.666415:0:7644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2d11 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524ac expref: 18 pid: 5848 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786445.666431:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103290f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7644:1874629686796160:192.168.204.34@tcp:104: 00000100:00100000:0.0:1787786445.666526:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5207b59000 going to sleep for 11 seconds 00000100:00100000:0.0:1787786445.671098:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786445.671170:0:8508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667929600 00000100:00100000:1.0:1787786445.671180:0:8508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667929600 00010000:00010000:1.0:1787786445.671219:0:8508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2d11 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524ac expref: 19 pid: 5848 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786445.671252:0:8508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 72 00000100:00100000:1.0:1787786445.671260:0:8508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103292580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:173d08e0-0e54-474e-858e-1679cd38cf14+19:2365:x1874629667929600:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787786445.671276:0:8508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786445.671282:0:8508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2d11 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524ac expref: 19 pid: 5848 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.671295:0:8508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2d11 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524ac expref: 19 pid: 5848 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.671317:0:8508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8b5204e6f000) 00010000:00010000:1.0:1787786445.671322:0:8508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2d50 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.671349:0:8508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2d50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.671356:0:8508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2d50 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.671376:0:8508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786445.671433:0:8508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103292580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:173d08e0-0e54-474e-858e-1679cd38cf14+19:2365:x1874629667929600:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 172us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786445.671440:0:8508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 72 00010000:00010000:1.0:1787786445.671576:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2d11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524ac expref: 18 pid: 5848 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786445.671589:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103290f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7644:1874629686796160:192.168.204.34@tcp:104: 00010000:00010000:1.0:1787786445.671612:0:7644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2d50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.671622:0:7644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2d50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.671627:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2d50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787786445.671916:0:7644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1787786445.672066:0:7644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1787786445.672112:0:7644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1787786445.672209:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5101aba580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7644:1874629686796288:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787786445.672253:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786445.672297:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b4be180 going to sleep for 11 seconds 00000100:00100000:3.0:1787786445.673874:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686796288 00000100:00100000:3.0:1787786445.673887:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686796288 00000100:00100000:3.0:1787786445.673972:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787786445.673989:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101ab9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7644:x1874629686796288:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787786445.674099:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101ab9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7644:x1874629686796288:12345-0@lo:1000:mdt00_003.0 Request processed in 112us (1845us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786445.674107:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787786445.675247:0:7644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1787786445.675256:0:7644:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b510331c000, transno 4294967315 00000100:00100000:1.0:1787786445.675276:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5101aba580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7644:1874629686796288:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1787786445.675779:0:7644:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1787786445.677417:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5101aba580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7644:1874629686796416:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787786445.677487:0:7644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786445.677517:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b4be900 going to sleep for 11 seconds 00000100:00100000:3.0:1787786445.677994:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686796416 00000100:00100000:3.0:1787786445.678002:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686796416 00000100:00100000:3.0:1787786445.678052:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787786445.678062:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101aba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7644:x1874629686796416:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1787786445.678311:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101aba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7644:x1874629686796416:12345-0@lo:1000:mdt00_003.0 Request processed in 249us (823us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1787786445.678319:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787786445.678353:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5101aba580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7644:1874629686796416:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1787786445.678393:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2d50 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.678403:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2d50 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.678410:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2d50 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.678416:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912c600 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786445.678420:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2d50 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.678427:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2d50 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.678443:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8b5204e6f000) 00010000:00010000:1.0:1787786445.678446:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787786445.678450:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2d50 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.678456:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2d50 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.678492:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff2c85 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.678499:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff2c85 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.678505:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff2c85 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.678510:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8e00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786445.678513:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff2c85 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.678518:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff2c85 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.678526:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b52100f1000) 00010000:00010000:1.0:1787786445.678528:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787786445.678531:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff2c85 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.678536:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff2c85 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.678554:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2d57 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.678568:0:7644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff2ca1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752490 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.678576:0:7644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2d57 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.678609:0:7644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff2ca1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752490 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786445.678621:0:7644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff2ca1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752490 expref: 21 pid: 5846 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786445.678634:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5101abb840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7644:1874629686796544:192.168.204.34@tcp:104: 00000100:00100000:1.0:1787786445.678701:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b4be900 going to sleep for 11 seconds 00000100:00100000:3.0:1787786445.691540:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786445.691577:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667929728 00000100:00100000:3.0:1787786445.691586:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667929728 00010000:00010000:3.0:1787786445.691632:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff2ca1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752490 expref: 22 pid: 5846 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786445.691669:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 73 00000100:00100000:3.0:1787786445.691679:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b437480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:173d08e0-0e54-474e-858e-1679cd38cf14+22:2365:x1874629667929728:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787786445.691694:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786445.691701:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff2ca1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752490 expref: 22 pid: 5846 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.691715:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff2ca1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752490 expref: 22 pid: 5846 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.691737:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b52100f1000) 00010000:00010000:3.0:1787786445.691753:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2d57 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.691763:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2d57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.691771:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2d57 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.691816:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787786445.691877:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b437480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:173d08e0-0e54-474e-858e-1679cd38cf14+22:2365:x1874629667929728:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 199us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786445.691885:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 73 00010000:00010000:3.0:1787786445.692900:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff2ca1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752490 expref: 21 pid: 5846 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786445.692920:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5101abb840 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7644:1874629686796544:192.168.204.34@tcp:104: 00010000:00010000:3.0:1787786445.692943:0:7644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2d57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.692953:0:7644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2d57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.692958:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2d57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.692971:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2d57 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.692978:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2d57 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.693001:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2d57 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.693006:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8c00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786445.693010:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2d57 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.693017:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2d57 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.693028:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b52100f1000) 00010000:00010000:3.0:1787786445.693031:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786445.693034:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2d57 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.693040:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2d57 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.693050:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2d49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.693055:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2d49 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.693060:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2d49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.693064:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912dc00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786445.693067:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2d49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.693081:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2d49 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.693089:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b52100f1000) 00010000:00010000:3.0:1787786445.693092:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787786445.693095:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2d49 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786445.693099:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2d49 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786445.694804:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b437840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+20:11537:x1874629667929472:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 28846us (29067us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1787786445.694820:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 186 00000020:00080000:3.0:1787786445.694826:0:7644:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787786445.695844:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787786445.695851:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787786445.696391:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1787786445.696719:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787786445.698584:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786445.698818:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667929984 00000100:00100000:2.0:1787786445.698828:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667929984 00000100:00100000:2.0:1787786445.698888:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 50 00000100:00100000:2.0:1787786445.698898:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52062fec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+20:11537:x1874629667929984:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787786445.699591:0:5850:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787786445.699687:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1787786445.699731:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff2d5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786445.699747:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff2d5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786445.699758:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff2d5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786445.699770:0:5850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff2d5e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786445.699777:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff2d5e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786445.699783:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff2d5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786445.699817:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787786445.700625:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52062fec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+22:11537:x1874629667929984:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 Request processed in 1723us (2044us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1787786445.700636:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 50 00000020:00080000:2.0:1787786445.700642:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787786445.702008:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787786445.702020:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff2d5e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786445.702030:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aadc00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:2.0:1787786445.702034:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff2d5e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786445.702044:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff2d5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786445.702060:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8b5210c81d00) 00010000:00010000:2.0:1787786445.702063:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787786445.702068:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff2d5e lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786445.702095:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aadc00/0x450132973bff2d5e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786445.702117:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786445.702119:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786445.702121:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787786445.870303:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:2.0:1787786445.870333:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:2.0:1787786445.870340:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00010000:00010000:1.0:1787786446.282436:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787786446.730284:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787786446.730294:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787786446.730324:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787786446.730330:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787786446.860846:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103291680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686796672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787786446.860933:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786446.861115:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686796672 00000100:00100000:0.0:1787786446.861124:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686796672 00000100:00100000:0.0:1787786446.861186:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787786446.861197:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b510331d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874629686796672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787786446.861235:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787786446.861286:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b510331d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874629686796672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786446.861294:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787786446.861357:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103291680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686796672:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787786447.310586:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787786447.662633:0:12523:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787786447.662642:0:12523:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787786447.662676:0:12523:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787786447.662681:0:12523:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787786447.821686:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786447.822588:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667930240 00000100:00100000:0.0:1787786447.822601:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667930240 00000100:00080000:3.0:1787786447.822677:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787786447.822684:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 187 00000100:00100000:0.0:1787786447.822701:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101372940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+22:11555:x1874629667930240:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1787786447.822726:0:8713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786447.822748:0:8713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2d65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7524c8 expref: -99 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786447.823073:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2d6c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786447.823090:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2d6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786447.823102:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2d6c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787786447.823113:0:8713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1787786447.823292:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2d65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524c8 expref: 25 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786447.823310:0:8713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2d6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524c8 expref: 24 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786447.823318:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b5204e6f400) 00010000:00010000:0.0:1787786447.823321:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787786447.823324:0:8713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912c600, rc 0) 00000100:00100000:0.0:1787786447.823410:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101372940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+24:11555:x1874629667930240:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 716us (1736us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1787786447.823427:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 187 00000100:00100000:2.0:1787786447.833419:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786447.833868:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667930368 00000100:00100000:1.0:1787786447.833880:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667930368 00000100:00100000:1.0:1787786447.834090:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 188 00000100:00100000:1.0:1787786447.834102:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b510331ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+24:11555:x1874629667930368:12345-192.168.204.34@tcp:34:lfs.0 00010000:00010000:1.0:1787786447.834191:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2d7a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.834209:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2d7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.834221:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2d7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.834235:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2d81 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.834255:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2d81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.834261:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2d81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.834574:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9800/0x450132973bff2d88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.834589:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9800/0x450132973bff2d88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.834597:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9800/0x450132973bff2d88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787786447.834637:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9800/0x450132973bff2d88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.834655:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2d7a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.834662:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2d7a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.834669:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2d7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.834675:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8c00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786447.834680:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2d7a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.834688:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2d7a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.834708:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b5204e6f400) 00010000:00010000:1.0:1787786447.834711:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787786447.834716:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2d7a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.834723:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2d7a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.834735:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2d81 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.834741:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2d81 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.834747:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2d81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.834753:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8400 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786447.834755:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2d81 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.834762:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2d81 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.834770:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b52100f1100) 00010000:00010000:1.0:1787786447.834773:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787786447.834776:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2d81 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.834781:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2d81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.834844:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9800/0x450132973bff2d88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.834851:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9800/0x450132973bff2d88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.834857:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9800/0x450132973bff2d88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.834863:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d9800 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786447.834866:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9800/0x450132973bff2d88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.834872:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9800/0x450132973bff2d88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.834880:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b52100f1a00) 00010000:00010000:1.0:1787786447.834883:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787786447.834886:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9800/0x450132973bff2d88 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.834891:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9800/0x450132973bff2d88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786447.835087:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b510331ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+24:11555:x1874629667930368:12345-192.168.204.34@tcp:34:lfs.0 Request processed in 984us (1674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786447.835098:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 188 00000100:00100000:2.0:1787786447.891058:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787786447.891082:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b510331cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874629686797056:0@lo:400:kworker.0 00000100:00100000:2.0:1787786447.891152:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786447.891245:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b510331e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686797184:0@lo:400:kworker.0 00000100:00100000:2.0:1787786447.891273:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786447.891358:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b510331f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686796800:0@lo:400:kworker.0 00000100:00100000:1.0:1787786447.891392:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786447.891432:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b510331d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874629686797312:0@lo:400:kworker.0 00000100:00100000:1.0:1787786447.891457:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786447.891478:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1787786447.891483:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b510331c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686796928:0@lo:400:kworker.0 00000100:00100000:1.0:1787786447.891504:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786447.891522:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b510331e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686797440:0@lo:400:kworker.0 00000100:00100000:1.0:1787786447.891559:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786447.891595:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686797056 00000100:00100000:1.0:1787786447.891602:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686797056 00000100:00100000:1.0:1787786447.891651:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686797312 00000100:00100000:1.0:1787786447.891654:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686797312 00000100:00100000:1.0:1787786447.891670:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686796928 00000100:00100000:1.0:1787786447.891673:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686796928 00000100:00100000:1.0:1787786447.891689:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787786447.891697:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b510331cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874629686797056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786447.891752:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b510331cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874629686797056:12345-0@lo:400:kworker.0 Request processed in 56us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786447.891759:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1787786447.891777:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787786447.891782:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101abbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874629686797312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786447.891844:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101abbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874629686797312:12345-0@lo:400:kworker.0 Request processed in 61us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786447.891850:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787786447.891860:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787786447.891866:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101aba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686796928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786447.891890:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101aba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686796928:12345-0@lo:400:kworker.0 Request processed in 25us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786447.891905:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787786447.891926:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686797184 00000100:00100000:1.0:1787786447.891930:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686797184 00000100:00100000:1.0:1787786447.891959:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686797440 00000100:00100000:1.0:1787786447.891962:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686797440 00000100:00100000:1.0:1787786447.891980:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787786447.892146:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b510331f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1874629686797184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786447.892181:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b510331f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1874629686797184:12345-0@lo:400:kworker.0 Request processed in 195us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786447.892187:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787786447.892199:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787786447.892206:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101ab9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686797440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786447.892232:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101ab9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686797440:12345-0@lo:400:kworker.0 Request processed in 27us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786447.892237:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787786447.892282:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b510331c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686796928:0@lo:400:kworker.0 00000100:00100000:1.0:1787786447.892291:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1787786447.892296:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:1.0:1787786447.892318:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b52328f61c0, transno 4294967307 00000100:00100000:1.0:1787786447.892329:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b510331e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686797440:0@lo:400:kworker.0 00000100:00100000:1.0:1787786447.892339:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b510331d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874629686797312:0@lo:400:kworker.0 00000100:00100000:2.0:1787786447.892637:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686796800 00000100:00100000:2.0:1787786447.892643:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686796800 00000100:00100000:2.0:1787786447.892674:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1787786447.892680:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3313:x1874629686796800:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787786447.892781:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787786447.892786:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787786447.892812:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787786447.894773:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3313:x1874629686796800:12345-0@lo:400:kworker.0 Request processed in 2083us (3369us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786447.894816:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1787786447.894961:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b510331e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686797184:0@lo:400:kworker.0 00000100:00100000:1.0:1787786447.894977:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b510331cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874629686797056:0@lo:400:kworker.0 00000100:00100000:1.0:1787786447.895035:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b510331f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686796800:0@lo:400:kworker.0 00000100:00100000:2.0:1787786447.900685:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786447.900761:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667930624 00000100:00100000:3.0:1787786447.900771:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667930624 00000100:00100000:3.0:1787786447.900876:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 189 00000100:00100000:3.0:1787786447.900953:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b510331fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+24:11559:x1874629667930624:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:3.0:1787786447.900980:0:8713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786447.901241:0:8713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff2d8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7524cf expref: -99 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.901623:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2d96 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.901640:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2d96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.901653:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2d96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.901668:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2d9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.901675:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2d9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.901681:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2d9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.903495:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2da4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.903513:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2da4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.903524:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2da4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786447.904153:0:8713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787786447.904270:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2d96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.904280:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2d96 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.904286:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2d96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.904292:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d4e00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786447.904297:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2d96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.904314:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2d96 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.904327:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b5204e6f400) 00010000:00010000:3.0:1787786447.904330:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786447.904335:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2d96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.904342:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2d96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.904355:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2d9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.904362:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2d9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.904368:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2d9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.904373:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d4c00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786447.904384:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2d9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.904390:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2d9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.904398:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b5204e6fe00) 00010000:00010000:3.0:1787786447.904400:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786447.904403:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2d9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.904409:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2d9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.905178:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff2d8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524cf expref: 27 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.905195:0:8713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2da4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524cf expref: 26 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.905202:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:3.0:1787786447.905205:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787786447.905208:0:8713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d5600, rc 0) 00000100:00100000:3.0:1787786447.905280:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b510331fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+26:11559:x1874629667930624:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 4394us (4602us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1787786447.905289:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 189 00000100:00100000:3.0:1787786447.915550:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786447.915626:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667930752 00000100:00100000:1.0:1787786447.915636:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667930752 00000100:00100000:1.0:1787786447.915698:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 190 00000100:00100000:1.0:1787786447.915709:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101371a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+26:11559:x1874629667930752:12345-192.168.204.34@tcp:54:lfs.0 00010000:00010000:1.0:1787786447.915779:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2db2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.915828:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2db2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.915842:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2db2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.915871:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2db2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.915879:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2db2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.915886:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2db2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.915891:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8400 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786447.915896:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2db2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.915903:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2db2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.915916:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:1.0:1787786447.915919:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787786447.915939:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2db2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.915946:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2db2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786447.916030:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101371a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+26:11559:x1874629667930752:12345-192.168.204.34@tcp:54:lfs.0 Request processed in 323us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786447.916038:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 190 00000100:00100000:3.0:1787786447.929188:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786447.931432:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667931008 00000100:00100000:0.0:1787786447.931447:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667931008 00000100:00100000:0.0:1787786447.931521:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 51 00000100:00100000:0.0:1787786447.931532:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+26:11559:x1874629667931008:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:0.0:1787786447.931765:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+27:11559:x1874629667931008:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 234us (2586us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1787786447.931773:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 51 00000100:00100000:0.0:1787786447.970258:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786447.970414:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667931264 00000100:00100000:3.0:1787786447.970424:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667931264 00000100:00100000:3.0:1787786447.970510:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 191 00000100:00100000:3.0:1787786447.970521:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103291680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+27:11085:x1874629667931264:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:3.0:1787786447.970545:0:7644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786447.970565:0:7644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff2db9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7524d6 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.970664:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2dc0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.970679:0:7644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2da4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524cf expref: 28 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.970688:0:7644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2dc0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.970728:0:7644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2da4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524cf expref: 28 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.970741:0:7644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2da4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524cf expref: 28 pid: 8713 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786447.970755:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5101373480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7644:1874629686797568:192.168.204.34@tcp:104: 00000100:00100000:3.0:1787786447.970896:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5102c4bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787786447.975522:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786447.975717:0:11675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667931392 00000100:00100000:1.0:1787786447.975725:0:11675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667931392 00000100:00100000:0.0:1787786447.975731:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5101373480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7644:1874629686797568:192.168.204.34@tcp:104: 00010000:00010000:0.0:1787786447.975760:0:7644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2dc0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.975766:0:11675:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2da4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524cf expref: 29 pid: 8713 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786447.975864:0:11675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 74 00000100:00100000:1.0:1787786447.975874:0:11675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b51013703c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:173d08e0-0e54-474e-858e-1679cd38cf14+29:2364:x1874629667931392:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787786447.975890:0:11675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786447.975897:0:11675:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2da4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524cf expref: 29 pid: 8713 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.975909:0:11675:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2da4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524cf expref: 29 pid: 8713 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.975931:0:11675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2da4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524cf expref: 29 pid: 8713 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.975945:0:11675:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:1.0:1787786447.975951:0:11675:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2dc0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.975976:0:11675:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2dc0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.975983:0:11675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2dc0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786447.976012:0:11675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787786447.976028:0:7644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2dc0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786447.976037:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2dc0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787786447.976056:0:7644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00000100:00100000:1.0:1787786447.976101:0:11675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b51013703c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:173d08e0-0e54-474e-858e-1679cd38cf14+28:2364:x1874629667931392:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 227us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786447.976109:0:11675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 74 00010000:00010000:0.0:1787786447.976208:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff2db9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524d6 expref: 29 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786447.976225:0:7644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2dc0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524d6 expref: 28 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786447.976233:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:0.0:1787786447.976242:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787786447.976245:0:7644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d4c00, rc 0) 00000100:00100000:0.0:1787786447.976273:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103291680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+28:11085:x1874629667931264:12345-192.168.204.34@tcp:101:bash.0 Request processed in 5754us (6037us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1787786447.976293:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 191 00000100:00100000:0.0:1787786447.979548:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786447.979650:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667931648 00000100:00100000:3.0:1787786447.979660:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667931648 00000100:00100000:3.0:1787786447.979711:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 192 00000100:00100000:3.0:1787786447.979721:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b51032921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+28:11085:x1874629667931648:12345-192.168.204.34@tcp:36:bash.0 00010000:00010000:3.0:1787786447.980526:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2dce lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.980546:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2dce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.980557:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2dce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787786447.980617:0:8713:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1787786447.980644:0:8713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007d07fd51 reply state 00000000860321c3 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2dce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786447.980653:0:8713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787786447.980709:0:8713:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1787786447.981044:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b51032921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+32:11085:x1874629667931648:12345-192.168.204.34@tcp:36:bash.0 Request processed in 1321us (1503us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1787786447.981053:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 192 00000020:00080000:3.0:1787786447.981059:0:8713:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1787786447.983064:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2dce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786447.983097:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2dce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786447.983105:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2dce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786447.983111:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d4e00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786447.983116:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2dce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786447.983123:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2dce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786447.983145:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:2.0:1787786447.983148:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786447.983153:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2dce lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786447.983159:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2dce lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786447.984233:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786447.984521:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667931776 00000100:00100000:3.0:1787786447.984530:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667931776 00000100:00100000:3.0:1787786447.984642:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 193 00000100:00100000:3.0:1787786447.984653:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103293840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+31:11085:x1874629667931776:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:3.0:1787786447.984676:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786447.984696:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff2dd5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7524dd expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.984757:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff2dd5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524dd expref: 32 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.984821:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff2dd5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524dd expref: 32 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786447.984844:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:3.0:1787786447.984847:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787786447.984850:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d5800, rc 0) 00000100:00100000:3.0:1787786447.984914:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103293840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+32:11085:x1874629667931776:12345-192.168.204.34@tcp:101:bash.0 Request processed in 263us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786447.984921:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 193 00000100:00100000:3.0:1787786447.988588:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786447.990777:0:12026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667931904 00000100:00100000:2.0:1787786447.990973:0:12026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667931904 00000100:00100000:2.0:1787786447.991052:0:12026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 58 00000100:00100000:2.0:1787786447.991062:0:12026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101371e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:173d08e0-0e54-474e-858e-1679cd38cf14+7:11085:x1874629667931904:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:2.0:1787786447.991080:0:12026:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786447.991101:0:12026:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021cd2b12/0x450132973bff2ddc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7524e4 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787786447.991128:0:12026:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8f74cc, atime: 0x6a8f74cb, ctime: 0x6a8f74cc, blocks: 0xb 00010000:00010000:2.0:1787786447.991165:0:12026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=374s v=(0 0) 00010000:00010000:2.0:1787786447.991169:0:12026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787786447.991178:0:12026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021cd2b12/0x450132973bff2ddc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524e4 expref: 8 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786447.991202:0:12026:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000021cd2b12/0x450132973bff2ddc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524e4 expref: 8 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786447.991216:0:12026:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aac600, rc 0) 00000100:00100000:2.0:1787786447.991412:0:12026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101371e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:173d08e0-0e54-474e-858e-1679cd38cf14+8:11085:x1874629667931904:12345-192.168.204.34@tcp:101:bash.0 Request processed in 349us (2833us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786447.991420:0:12026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 58 00000100:00080000:3.0:1787786447.991475:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787786447.995572:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786447.995867:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667932032 00000100:00100000:3.0:1787786447.995878:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667932032 00002000:00010000:3.0:1787786447.995920:0:6706:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1787786447.995925:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8b5103293c00 with x1874629667932032 ext(0->18446744073709551615) 00002000:00010000:3.0:1787786447.996194:0:6706:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b5103293c00. 00000100:00100000:3.0:1787786447.996232:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 5 00000100:00100000:3.0:1787786447.996244:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103293c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:173d08e0-0e54-474e-858e-1679cd38cf14+8:2364:x1874629667932032:12345-192.168.204.34@tcp:10:bash.0 00002000:00010000:3.0:1787786447.996762:0:6706:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1787786447.996767:0:6706:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1787786444 -> 1787786448 00002000:00010000:3.0:1787786447.996770:0:6706:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1787786443 -> 1787786443 00002000:00010000:3.0:1787786447.996772:0:6706:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1787786444 -> 1787786448 00002000:00010000:3.0:1787786447.996774:0:6706:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1787786447.997198:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103293c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:173d08e0-0e54-474e-858e-1679cd38cf14+9:2364:x1874629667932032:12345-192.168.204.34@tcp:10:bash.0 Request processed in 953us (1697us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1787786447.997225:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 5 00002000:00010000:3.0:1787786447.997229:0:6706:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1787786447.997232:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8b5103293c00 with x1874629667932032 ext(0->18446744073709551615) 00002000:00010000:3.0:1787786447.997238:0:6706:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b5103293c00. 00000100:00100000:0.0:1787786448.061061:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786448.065076:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667932160 00000100:00100000:3.0:1787786448.065092:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667932160 00000100:00100000:2.0:1787786448.068360:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 194 00000100:00100000:2.0:1787786448.068377:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103292940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+32:11573:x1874629667932160:12345-192.168.204.34@tcp:34:lfs.0 00010000:00010000:2.0:1787786448.068457:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff2de3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.068475:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff2de3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.068486:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff2de3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.068501:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2dea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.068519:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2dea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.068543:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2dea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.068863:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2df1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.068874:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2df1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.068882:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2df1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787786448.068921:0:7644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2df1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.068933:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff2de3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.068945:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff2de3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.068952:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff2de3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.068959:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aade00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786448.068963:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff2de3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.068971:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff2de3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.068983:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b5204e6f400) 00010000:00010000:2.0:1787786448.068992:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786448.068998:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff2de3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.069004:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff2de3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.069017:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2dea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.069023:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2dea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.069028:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2dea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.069033:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aac400 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786448.069036:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2dea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.069042:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2dea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.069050:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b5210c81700) 00010000:00010000:2.0:1787786448.069052:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786448.069055:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2dea lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.073076:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2dea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.073113:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2df1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.073138:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2df1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.073144:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2df1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.073151:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aacc00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786448.073156:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2df1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.073163:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2df1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.073180:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:2.0:1787786448.073183:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786448.073188:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2df1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.073193:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2df1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786448.073306:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103292940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+32:11573:x1874629667932160:12345-192.168.204.34@tcp:34:lfs.0 Request processed in 4928us (12250us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786448.073316:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 194 00000100:00100000:0.0:1787786448.120334:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786448.120423:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667932416 00000100:00100000:3.0:1787786448.120433:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667932416 00000100:00100000:3.0:1787786448.120507:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 195 00000100:00100000:3.0:1787786448.120518:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103291a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+32:11576:x1874629667932416:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:3.0:1787786448.120543:0:8713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786448.120565:0:8713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2df8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7524eb expref: -99 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.120639:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2dff lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.120654:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2dff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.120666:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2dff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.120680:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2e06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.120901:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2e06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.120926:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2e06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.121603:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff2e0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.121615:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff2e0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.121622:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff2e0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786448.121631:0:8713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787786448.121837:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2dff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.121846:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2dff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.121853:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2dff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.121858:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d4a00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786448.121863:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2dff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.122229:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2dff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.122241:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b5204e6f400) 00010000:00010000:3.0:1787786448.122244:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786448.122256:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2dff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.122262:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2dff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.122349:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2e06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.122358:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2e06 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.122365:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2e06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.122370:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d5c00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786448.122373:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2e06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.122379:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2e06 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.122387:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b5204e6fe00) 00010000:00010000:3.0:1787786448.122390:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786448.122393:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2e06 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.122527:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2e06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.122579:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2df8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524eb expref: 35 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.122605:0:8713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff2e0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524eb expref: 34 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.122611:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:3.0:1787786448.122613:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787786448.122615:0:8713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d4000, rc 0) 00000100:00100000:3.0:1787786448.122980:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103291a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+34:11576:x1874629667932416:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 2461us (2653us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1787786448.122990:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 195 00000100:00100000:0.0:1787786448.127599:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786448.127901:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667932544 00000100:00100000:3.0:1787786448.127911:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667932544 00000100:00100000:3.0:1787786448.128440:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 196 00000100:00100000:3.0:1787786448.128463:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+34:11576:x1874629667932544:12345-192.168.204.34@tcp:54:lfs.0 00010000:00010000:3.0:1787786448.128535:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2e1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.128551:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2dc0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524d6 expref: 34 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.128562:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2e1b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.128602:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2dc0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524d6 expref: 34 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.128615:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2dc0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524d6 expref: 34 pid: 7644 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786448.128644:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b51013712c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874629686797696:192.168.204.34@tcp:104: 00000100:00100000:3.0:1787786448.128761:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5102c4b240 going to sleep for 11 seconds 00000100:00100000:0.0:1787786448.135945:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786448.136019:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667932800 00000100:00100000:2.0:1787786448.136030:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667932800 00000100:00100000:1.0:1787786448.136074:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b51013712c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874629686797696:192.168.204.34@tcp:104: 00000100:00100000:2.0:1787786448.136098:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 52 00010000:00010000:1.0:1787786448.136102:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2e1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786448.136111:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+35:6078:x1874629667932800:12345-192.168.204.34@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787786448.136445:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+36:6078:x1874629667932800:12345-192.168.204.34@tcp:35:ldlm_bl.0 Request processed in 337us (508us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1787786448.136465:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 52 00000100:00100000:0.0:1787786448.138921:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786448.139012:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667932928 00000100:00100000:1.0:1787786448.139023:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667932928 00010000:00010000:1.0:1787786448.139063:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2dc0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524d6 expref: 36 pid: 7644 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786448.139108:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 75 00000100:00100000:1.0:1787786448.139117:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5211bf9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+36:2365:x1874629667932928:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787786448.139134:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786448.139151:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2dc0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524d6 expref: 36 pid: 7644 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.139164:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2dc0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524d6 expref: 36 pid: 7644 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.139207:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff2dc0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524d6 expref: 36 pid: 7644 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.139223:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:1.0:1787786448.139227:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2e1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.139237:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2e1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.139245:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2e1b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.139290:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786448.139349:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5211bf9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+35:2365:x1874629667932928:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 229us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786448.139357:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 75 00010000:00010000:2.0:1787786448.140536:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2e1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.140552:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2e1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.140587:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2e1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.140600:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2e1b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.140607:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2e1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.140614:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d5400 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786448.140619:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2e1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.140627:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2e1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.140642:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:2.0:1787786448.140644:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787786448.140649:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2e1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.140655:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff2e1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786448.140718:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+34:11576:x1874629667932544:12345-192.168.204.34@tcp:54:lfs.0 Request processed in 12266us (13128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786448.140741:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 196 00000100:00100000:3.0:1787786448.143325:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786448.143568:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667933184 00000100:00100000:2.0:1787786448.143577:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667933184 00000100:00100000:2.0:1787786448.143645:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 53 00000100:00100000:2.0:1787786448.143655:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101372d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+34:11576:x1874629667933184:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:2.0:1787786448.144698:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101372d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+35:11576:x1874629667933184:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 1027us (1366us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1787786448.144709:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 53 00000100:00100000:0.0:1787786448.239088:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786448.239203:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667933440 00000100:00100000:2.0:1787786448.239213:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667933440 00000100:00100000:1.0:1787786448.239368:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 197 00000100:00100000:1.0:1787786448.239383:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b51032903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+35:11587:x1874629667933440:12345-192.168.204.34@tcp:101:cat.0 00010000:00010000:1.0:1787786448.239428:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786448.239451:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2e22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7524f2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.239531:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2e29 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.239546:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2e29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.239575:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2e29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.239592:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff2e30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.239599:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff2e30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.239604:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff2e30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.240633:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8000/0x450132973bff2e37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.240646:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8000/0x450132973bff2e37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.240655:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8000/0x450132973bff2e37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787786448.240665:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1787786448.241157:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2e29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.241168:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2e29 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.241175:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2e29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.241181:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8c00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786448.241193:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2e29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.241201:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2e29 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.241214:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b5204e6f400) 00010000:00010000:1.0:1787786448.241217:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787786448.241222:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2e29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.241228:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2e29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.241242:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff2e30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.241248:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff2e30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.241254:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff2e30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.241259:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d9a00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786448.241262:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff2e30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.241269:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff2e30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.241469:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b52100f1a00) 00010000:00010000:1.0:1787786448.241472:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787786448.241482:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff2e30 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.241488:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff2e30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.241540:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2e22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524f2 expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.241555:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8000/0x450132973bff2e37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524f2 expref: 37 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.241562:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:1.0:1787786448.241565:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787786448.241567:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523b4d8000, rc 0) 00000100:00100000:1.0:1787786448.241648:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b51032903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+37:11587:x1874629667933440:12345-192.168.204.34@tcp:101:cat.0 Request processed in 2270us (2572us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1787786448.241657:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 197 00000100:00100000:0.0:1787786448.247391:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786448.247990:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667933696 00000100:00100000:2.0:1787786448.248001:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667933696 00000100:00100000:2.0:1787786448.248064:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 54 00000100:00100000:2.0:1787786448.248074:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103291e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+37:11587:x1874629667933696:12345-192.168.204.34@tcp:35:cat.0 00000100:00100000:2.0:1787786448.248897:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103291e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+38:11587:x1874629667933696:12345-192.168.204.34@tcp:35:cat.0 Request processed in 821us (1514us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1787786448.248908:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 54 00000100:00100000:3.0:1787786448.276587:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786448.276825:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667933952 00000100:00100000:1.0:1787786448.276836:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667933952 00000100:00100000:1.0:1787786448.277006:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 198 00000100:00100000:1.0:1787786448.277018:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b51013730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+38:11588:x1874629667933952:12345-192.168.204.34@tcp:36:rm.0 00010000:00010000:1.0:1787786448.277081:0:8713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787786448.277108:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8000/0x450132973bff2e37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524f2 expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.277127:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff2e0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524eb expref: 37 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.277160:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff2dd5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524dd expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.277170:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b5204e6f100) 00010000:00010000:1.0:1787786448.277180:0:8713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787786448.277262:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2e45 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.278517:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2e45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.278536:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2e45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.278562:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff2e4c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.278571:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff2e4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.278578:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff2e4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.279352:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2e53 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.279364:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2e53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.279371:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2e53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787786448.284056:0:8713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1787786448.284071:0:8713:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 374642279968ns, next at 375642276306ns, rc = 0 00010000:00010000:1.0:1787786448.284148:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9e00/0x450132973bff2e5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.284166:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9e00/0x450132973bff2e5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.284178:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9e00/0x450132973bff2e5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.284186:0:8713:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9e00/0x450132973bff2e5a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.284193:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9e00/0x450132973bff2e5a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.284200:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9e00/0x450132973bff2e5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.284228:0:8713:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787786448.284251:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2e53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.284257:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2e53 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.284264:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2e53 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.284269:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8c00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786448.284282:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2e53 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.284291:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2e53 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.284305:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b52100f1100) 00010000:00010000:1.0:1787786448.284308:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787786448.284313:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2e53 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.284314:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787786448.284326:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9e00/0x450132973bff2e5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.284326:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2e53 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.284345:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d9e00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:2.0:1787786448.284350:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9e00/0x450132973bff2e5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.284358:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9e00/0x450132973bff2e5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.284361:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2e45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.284370:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2e45 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.284386:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2e45 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.284389:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8b52100f1100) 00010000:00010000:1.0:1787786448.284391:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8400 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786448.284394:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787786448.284396:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2e45 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.284400:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9e00/0x450132973bff2e5a lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.284408:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2e45 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.284411:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9e00/0x450132973bff2e5a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.284423:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b5204e6f400) 00010000:00010000:1.0:1787786448.284428:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786448.284434:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786448.284437:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786448.284440:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786448.284440:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2e45 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.284450:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2e45 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787786448.284463:0:8713:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c394383 reply state 00000000a040f123 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff2e4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786448.284472:0:8713:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787786448.284581:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b51013730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+37:11588:x1874629667933952:12345-192.168.204.34@tcp:36:rm.0 Request processed in 7560us (7999us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1787786448.284590:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 198 00010000:00010000:3.0:1787786448.289603:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff2e4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.289622:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff2e4c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.289630:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff2e4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.289637:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d9a00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786448.289642:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff2e4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.289650:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff2e4c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.289668:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b52100f1a00) 00010000:00010000:3.0:1787786448.289670:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786448.289674:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff2e4c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.289691:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff2e4c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.330673:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786448.348096:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786448.349638:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667934208 00000100:00100000:2.0:1787786448.349654:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667934208 00000100:00100000:2.0:1787786448.349734:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 199 00000100:00100000:2.0:1787786448.349744:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101370780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+36:11594:x1874629667934208:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:2.0:1787786448.349767:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786448.349824:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2e61 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7524f9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.349959:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2e68 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.349974:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2e68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.349984:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2e68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.349998:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff2e6f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.350016:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff2e6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.350022:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff2e6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787786448.350557:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1787786448.350719:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2e76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.350729:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2e76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.350737:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2e76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.350769:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2e68 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.350777:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2e68 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.350835:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2e68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.350842:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aac400 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786448.350847:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2e68 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.350855:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2e68 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.350891:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b5204e6f400) 00010000:00010000:2.0:1787786448.350894:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786448.350899:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2e68 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.350905:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff2e68 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787786448.350918:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e233fdbc reply state 000000006b07011a transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff2e6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786448.350926:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787786448.350955:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2e61 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524f9 expref: 39 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.350970:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2e76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524f9 expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.350977:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5210c81e00) 00010000:00010000:2.0:1787786448.350979:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787786448.350981:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aac000, rc 0) 00000100:00100000:2.0:1787786448.351056:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101370780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+39:11594:x1874629667934208:12345-192.168.204.34@tcp:101:bash.0 Request processed in 1314us (2973us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1787786448.351065:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 199 00010000:00010000:2.0:1787786448.354526:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff2e6f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.354545:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff2e6f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.354585:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff2e6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.354592:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aade00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786448.354597:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff2e6f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.354605:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff2e6f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.354623:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b5210c81700) 00010000:00010000:2.0:1787786448.354627:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786448.354631:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff2e6f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.354638:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff2e6f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786448.355908:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786448.356546:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667934336 00000100:00100000:1.0:1787786448.356557:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667934336 00000100:00100000:1.0:1787786448.356644:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 59 00000100:00100000:1.0:1787786448.356655:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101370b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:173d08e0-0e54-474e-858e-1679cd38cf14+5:2363:x1874629667934336:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:1.0:1787786448.356673:0:6700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786448.356692:0:6700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fadf59a1/0x450132973bff2e84 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752500 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787786448.356719:0:6700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787786448.356738:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=374s v=(0 0) 00010000:00010000:1.0:1787786448.356743:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786448.356753:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fadf59a1/0x450132973bff2e84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752500 expref: 6 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.356774:0:6700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fadf59a1/0x450132973bff2e84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752500 expref: 6 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.356833:0:6700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523b4d8400, rc 0) 00000100:00080000:3.0:1787786448.356893:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787786448.356906:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101370b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:173d08e0-0e54-474e-858e-1679cd38cf14+6:2363:x1874629667934336:12345-192.168.204.34@tcp:101:bash.0 Request processed in 253us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786448.356915:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 59 00000100:00100000:0.0:1787786448.360962:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786448.361156:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667934464 00000100:00100000:3.0:1787786448.361166:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667934464 00000100:00100000:3.0:1787786448.361222:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 60 00000100:00100000:3.0:1787786448.361232:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103292580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+6:11594:x1874629667934464:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:3.0:1787786448.361254:0:8126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786448.361272:0:8126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fc58dad/0x450132973bff2e8b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752507 expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.361314:0:8126:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fadf59a1/0x450132973bff2e84 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752500 expref: 7 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.361323:0:8126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787786448.361328:0:8126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787786448.361334:0:8126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fc58dad/0x450132973bff2e8b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752507 expref: 7 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.361371:0:8126:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fadf59a1/0x450132973bff2e84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752500 expref: 7 pid: 6700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.361385:0:8126:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fadf59a1/0x450132973bff2e84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752500 expref: 7 pid: 6700 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786448.361399:0:8126:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5101370f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8126:1874629686797824:192.168.204.34@tcp:104: 00000100:00100000:3.0:1787786448.361497:0:8126:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5102c4bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787786448.365715:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786448.365864:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667934592 00000100:00100000:1.0:1787786448.365874:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667934592 00010000:00010000:1.0:1787786448.365914:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fadf59a1/0x450132973bff2e84 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752500 expref: 8 pid: 6700 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786448.365949:0:8126:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5101370f00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8126:1874629686797824:192.168.204.34@tcp:104: 00000100:00100000:1.0:1787786448.365957:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 76 00000100:00100000:1.0:1787786448.365967:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103290f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:173d08e0-0e54-474e-858e-1679cd38cf14+8:2365:x1874629667934592:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787786448.365981:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786448.365988:0:8126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004fc58dad/0x450132973bff2e8b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752507 expref: 8 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.366005:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fadf59a1/0x450132973bff2e84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752500 expref: 8 pid: 6700 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.366007:0:8126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d5c00, rc 0) 00010000:00010000:1.0:1787786448.366022:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fadf59a1/0x450132973bff2e84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752500 expref: 8 pid: 6700 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.366046:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fadf59a1/0x450132973bff2e84 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752500 expref: 8 pid: 6700 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.366061:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786448.366066:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786448.366076:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004fc58dad/0x450132973bff2e8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752507 expref: 7 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786448.366078:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103292580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+7:11594:x1874629667934464:12345-192.168.204.34@tcp:101:bash.0 Request processed in 4844us (5132us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786448.366086:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 60 00010000:00010000:1.0:1787786448.366103:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fc58dad/0x450132973bff2e8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752507 expref: 6 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.366135:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004fc58dad/0x450132973bff2e8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752507 expref: 6 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786448.366149:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5101ab8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5831:1874629686797952:192.168.204.34@tcp:105: 00000100:00100000:1.0:1787786448.366200:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b4becc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787786448.371148:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786448.371246:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667934848 00000100:00100000:2.0:1787786448.371258:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667934848 00000100:00100000:2.0:1787786448.371334:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 55 00000100:00100000:2.0:1787786448.371346:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+38:11594:x1874629667934848:12345-192.168.204.34@tcp:35:bash.0 00000100:00100000:2.0:1787786448.371727:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+39:11594:x1874629667934848:12345-192.168.204.34@tcp:35:bash.0 Request processed in 382us (590us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1787786448.371736:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 55 00000100:00100000:1.0:1787786448.373603:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5101ab8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5831:1874629686797952:192.168.204.34@tcp:105: 00010000:00010000:1.0:1787786448.373633:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786448.373687:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103290f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:173d08e0-0e54-474e-858e-1679cd38cf14+6:2365:x1874629667934592:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 7720us (7982us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786448.373700:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 76 00000100:00100000:0.0:1787786448.395709:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787786448.395746:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b510331e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686798080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787786448.395850:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786448.395944:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686798080 00000100:00100000:2.0:1787786448.395952:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686798080 00000100:00100000:2.0:1787786448.396010:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787786448.396035:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b435680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686798080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787786448.396074:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787786448.396122:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b435680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686798080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786448.396129:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787786448.396284:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b510331e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686798080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787786448.530398:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786448.530509:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667934976 00000100:00100000:1.0:1787786448.530521:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667934976 00000100:00100000:1.0:1787786448.530586:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 200 00000100:00100000:1.0:1787786448.530597:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+39:11610:x1874629667934976:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:1.0:1787786448.530621:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786448.530644:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2e92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75250e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.530710:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2e99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.530726:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2e99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.530746:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2e99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787786448.530847:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787786448.530869:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787786448.530897:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2e99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.530925:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2e92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75250e expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.530946:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2e99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75250e expref: 40 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.530955:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b5204e6f400) 00010000:00010000:1.0:1787786448.530958:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787786448.530962:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523b4d8c00, rc 0) 00000100:00100000:1.0:1787786448.531035:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a570c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+40:11610:x1874629667934976:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 439us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786448.531042:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 200 00000100:00100000:3.0:1787786448.539609:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786448.539834:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667935232 00000100:00100000:1.0:1787786448.539843:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667935232 00000100:00100000:1.0:1787786448.539923:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 201 00000100:00100000:1.0:1787786448.539934:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101370f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+40:11610:x1874629667935232:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:1.0:1787786448.539956:0:8713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786448.539976:0:8713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2ea0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752515 expref: -99 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.540101:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8000/0x450132973bff2ea7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.540116:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8000/0x450132973bff2ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.540128:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8000/0x450132973bff2ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787786448.540140:0:8713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787786448.540271:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8400/0x450132973bff2ea0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752515 expref: 43 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.540288:0:8713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8000/0x450132973bff2ea7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752515 expref: 42 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.540296:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5210c81e00) 00010000:00010000:1.0:1787786448.540299:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787786448.540302:0:8713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523b4d8000, rc 0) 00000100:00100000:1.0:1787786448.540374:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101370f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+42:11610:x1874629667935232:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 442us (776us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1787786448.540382:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 201 00000100:00100000:3.0:1787786448.543197:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786448.543377:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667935488 00000100:00100000:2.0:1787786448.543388:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667935488 00000100:00100000:2.0:1787786448.543442:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 202 00000100:00100000:2.0:1787786448.543454:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101372580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+42:11610:x1874629667935488:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:2.0:1787786448.543480:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786448.543502:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff2eb5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75251c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.543599:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2ebc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.543613:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2ebc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.543623:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2ebc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786448.543635:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787786448.543758:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff2eb5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75251c expref: 45 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786448.544320:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786448.544399:0:8508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667935616 00000100:00100000:0.0:1787786448.544405:0:8508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667935616 00000100:00100000:0.0:1787786448.544457:0:8508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 15 00000100:00100000:0.0:1787786448.544466:0:8508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101371680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:173d08e0-0e54-474e-858e-1679cd38cf14+45:2365:x1874629667935616:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787786448.544493:0:8508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787786448.544509:0:8508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8000/0x450132973bff2ea7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752515 expref: 45 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.544527:0:8508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5210c81e00) 00010000:00010000:0.0:1787786448.544531:0:8508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787786448.544581:0:8508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101371680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:173d08e0-0e54-474e-858e-1679cd38cf14+44:2365:x1874629667935616:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 116us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786448.544588:0:8508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 15 00010000:00010000:2.0:1787786448.544810:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2ebc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75251c expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.544832:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5210c81e00) 00010000:00010000:2.0:1787786448.544834:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787786448.544836:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aacc00, rc 0) 00000100:00100000:2.0:1787786448.544869:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101372580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+43:11610:x1874629667935488:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 1418us (1682us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1787786448.544876:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 202 00000100:00100000:3.0:1787786448.550368:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786448.550428:0:12026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667935744 00000100:00100000:2.0:1787786448.550516:0:12026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667935744 00000100:00100000:2.0:1787786448.550626:0:12026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 61 00000100:00100000:2.0:1787786448.550638:0:12026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b51013721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:173d08e0-0e54-474e-858e-1679cd38cf14+6:2365:x1874629667935744:12345-192.168.204.34@tcp:1:lfs.0 00010000:00010000:2.0:1787786448.550696:0:12026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000309a4d86/0x450132973bff2eca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.550715:0:12026:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004fc58dad/0x450132973bff2e8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752507 expref: 6 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.550724:0:12026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787786448.550728:0:12026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787786448.550732:0:12026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000309a4d86/0x450132973bff2eca lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.550767:0:12026:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004fc58dad/0x450132973bff2e8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752507 expref: 6 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.551043:0:12026:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004fc58dad/0x450132973bff2e8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752507 expref: 6 pid: 8126 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786448.551076:0:12026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b510331e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12026:1874629686798208:192.168.204.34@tcp:104: 00000100:00100000:2.0:1787786448.551174:0:12026:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5203e75000 going to sleep for 11 seconds 00000100:00100000:0.0:1787786448.554334:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786448.554407:0:12026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b510331e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:12026:1874629686798208:192.168.204.34@tcp:104: 00000100:00100000:1.0:1787786448.554407:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667935872 00000100:00100000:1.0:1787786448.554413:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667935872 00010000:00010000:2.0:1787786448.554434:0:12026:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000309a4d86/0x450132973bff2eca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1787786448.554461:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8b5237a54780 x1874629667935872/t0(0) o4->173d08e0-0e54-474e-858e-1679cd38cf14@192.168.204.34@tcp:64/0 lens 504/0 e 0 to 0 dl 1787786459 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787786448.554470:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8b5237a54780 with x1874629667935872 ext(0->8) 00010000:00010000:1.0:1787786448.554490:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004fc58dad/0x450132973bff2e8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752507 expref: 7 pid: 8126 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.554505:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004fc58dad/0x450132973bff2e8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752507 expref: 7 pid: 8126 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787786448.554513:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8b5237a54780 00000100:00100000:1.0:1787786448.554536:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 3 00000100:00100000:1.0:1787786448.554546:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a54780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:173d08e0-0e54-474e-858e-1679cd38cf14+7:2365:x1874629667935872:12345-192.168.204.34@tcp:4:lfs.0 00000100:00100000:1.0:1787786448.555266:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a54780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:173d08e0-0e54-474e-858e-1679cd38cf14+9:2365:x1874629667935872:12345-192.168.204.34@tcp:4:lfs.0 Request processed in 717us (942us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787786448.555276:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 3 00002000:00100000:1.0:1787786448.555285:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8b5237a54780 x1874629667935872/t4294967308(0) o4->173d08e0-0e54-474e-858e-1679cd38cf14@192.168.204.34@tcp:64/0 lens 504/448 e 0 to 0 dl 1787786459 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787786448.555293:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8b5237a54780 with x1874629667935872 ext(0->8) 00010000:00010000:1.0:1787786448.555299:0:6704:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004fc58dad/0x450132973bff2e8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752507 expref: 9 pid: 8126 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.555313:0:6704:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004fc58dad/0x450132973bff2e8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752507 expref: 9 pid: 8126 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787786448.555321:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8b5237a54780 00000100:00100000:3.0:1787786448.559670:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786448.560017:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667936000 00000100:00100000:0.0:1787786448.560028:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667936000 00010000:00010000:0.0:1787786448.560074:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004fc58dad/0x450132973bff2e8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752507 expref: 9 pid: 8126 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786448.560113:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 77 00000100:00100000:0.0:1787786448.560235:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101373840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:173d08e0-0e54-474e-858e-1679cd38cf14+9:2365:x1874629667936000:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787786448.560254:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787786448.560333:0:5832:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787786448.560337:0:5832:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787786448 00002000:00010000:0.0:1787786448.560339:0:5832:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787786448 00002000:00010000:0.0:1787786448.560341:0:5832:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787786448 00010000:00010000:0.0:1787786448.560347:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004fc58dad/0x450132973bff2e8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752507 expref: 9 pid: 8126 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.560361:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004fc58dad/0x450132973bff2e8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752507 expref: 9 pid: 8126 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.560401:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fc58dad/0x450132973bff2e8b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752507 expref: 9 pid: 8126 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.560419:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787786448.560424:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787786448.560429:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000309a4d86/0x450132973bff2eca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.560439:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000309a4d86/0x450132973bff2eca lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.560878:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787786448.560957:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101373840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:173d08e0-0e54-474e-858e-1679cd38cf14+8:2365:x1874629667936000:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 834us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786448.560966:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 77 00010000:00010000:2.0:1787786448.564080:0:12026:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000309a4d86/0x450132973bff2eca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.564104:0:12026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000309a4d86/0x450132973bff2eca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.564150:0:12026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000309a4d86/0x450132973bff2eca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.564159:0:12026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000309a4d86/0x450132973bff2eca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.564171:0:12026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000309a4d86/0x450132973bff2eca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.564179:0:12026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aade00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:2.0:1787786448.564184:0:12026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000309a4d86/0x450132973bff2eca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.564224:0:12026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000309a4d86/0x450132973bff2eca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.564248:0:12026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000309a4d86/0x450132973bff2eca lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.564257:0:12026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000309a4d86/0x450132973bff2eca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786448.564387:0:12026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b51013721c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:173d08e0-0e54-474e-858e-1679cd38cf14+7:2365:x1874629667935744:12345-192.168.204.34@tcp:1:lfs.0 Request processed in 13746us (14023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786448.564398:0:12026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 61 00000100:00100000:2.0:1787786448.568221:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786448.568293:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667936256 00000100:00100000:0.0:1787786448.568302:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667936256 00000100:00100000:0.0:1787786448.568358:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 56 00000100:00100000:0.0:1787786448.568367:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52062fd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+43:11610:x1874629667936256:12345-192.168.204.34@tcp:35:lfs.0 00000004:00010000:0.0:1787786448.568424:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2ebc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75251c expref: 43 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787786448.568670:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1787786448.568725:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:0.0:1787786448.569172:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:0.0:1787786448.569219:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2ed1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.569245:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2e76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524f9 expref: 47 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.569254:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2ed1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.569286:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2e76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524f9 expref: 47 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.569301:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2e76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524f9 expref: 47 pid: 5847 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786448.569321:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237a54b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874629686798336:192.168.204.34@tcp:104: 00000100:00100000:0.0:1787786448.570039:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52328bd6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787786448.574664:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237a54b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1874629686798336:192.168.204.34@tcp:104: 00010000:00010000:0.0:1787786448.574855:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2ed1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786448.575230:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786448.575320:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667936384 00000100:00100000:1.0:1787786448.575327:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667936384 00010000:00010000:1.0:1787786448.575363:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2e76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524f9 expref: 48 pid: 5847 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786448.575421:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 78 00000100:00100000:1.0:1787786448.575431:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b510331e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:173d08e0-0e54-474e-858e-1679cd38cf14+48:2364:x1874629667936384:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787786448.575462:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786448.575470:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2e76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524f9 expref: 48 pid: 5847 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.575482:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2e76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524f9 expref: 48 pid: 5847 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.575506:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac000/0x450132973bff2e76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524f9 expref: 48 pid: 5847 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.575521:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5210c81e00) 00010000:00010000:1.0:1787786448.575526:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2ed1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.575534:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2ed1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.575542:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2ed1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.575576:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786448.575643:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b510331e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:173d08e0-0e54-474e-858e-1679cd38cf14+47:2364:x1874629667936384:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 213us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786448.575651:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 78 00010000:00010000:2.0:1787786448.576343:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2ed1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.576354:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2ed1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787786448.576496:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1787786448.577083:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:2.0:1787786448.577202:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b510331da40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874629686798464:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787786448.577264:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786448.577289:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5203e75d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787786448.577346:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686798464 00000100:00100000:0.0:1787786448.577355:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686798464 00000100:00100000:0.0:1787786448.577461:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787786448.577472:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b510331c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1874629686798464:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1787786448.577554:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b510331c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1874629686798464:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 84us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786448.577561:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787786448.577629:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b510331da40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874629686798464:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787786448.578132:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1787786448.578188:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b510331da40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874629686798592:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787786448.578217:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786448.581193:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5203e75000 going to sleep for 11 seconds 00000100:00100000:3.0:1787786448.581230:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686798592 00000100:00100000:3.0:1787786448.581240:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686798592 00000100:00100000:3.0:1787786448.581292:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787786448.581302:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b510331f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1874629686798592:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787786448.581773:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b510331f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5849:x1874629686798592:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 472us (3553us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787786448.581883:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787786448.582162:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b510331da40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1874629686798592:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787786448.582241:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1787786448.582288:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2ed1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.582299:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2ed1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.582307:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2ed1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.582313:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912c000 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786448.582318:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2ed1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.582327:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2ed1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.582343:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5210c81e00) 00010000:00010000:2.0:1787786448.582346:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787786448.582351:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2ed1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.582357:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2ed1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787786448.582566:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787786448.583086:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1787786448.583099:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 374941307490ns, next at 375941305200ns, rc = 0 00000001:00080000:2.0:1787786448.583106:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1787786448.583144:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5210c81e00) 00010000:00010000:2.0:1787786448.583147:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787786448.583155:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff2ebc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75251c expref: 51 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786448.583317:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52062fd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+50:11610:x1874629667936256:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 14949us (15104us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1787786448.583328:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 56 00000020:00080000:2.0:1787786448.583333:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787786448.587932:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786448.588072:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667936512 00000100:00100000:0.0:1787786448.588094:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667936512 00000100:00100000:0.0:1787786448.588152:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 203 00000100:00100000:0.0:1787786448.588161:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b510331cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+50:11610:x1874629667936512:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1787786448.588189:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786448.588211:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff2ed8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752523 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.588270:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff2ed8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752523 expref: 51 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.588284:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff2ed8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752523 expref: 51 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.588301:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5222ae8600) 00010000:00010000:0.0:1787786448.588304:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787786448.588307:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912d400, rc 0) 00000100:00100000:0.0:1787786448.588361:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b510331cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+51:11610:x1874629667936512:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 201us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786448.588368:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 203 00000100:00100000:1.0:1787786448.591257:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786448.591589:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667936768 00000100:00100000:2.0:1787786448.591600:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667936768 00000100:00100000:2.0:1787786448.591889:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 57 00000100:00100000:2.0:1787786448.591902:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+51:11610:x1874629667936768:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:2.0:1787786448.592249:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+52:11610:x1874629667936768:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 349us (1001us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1787786448.592257:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 57 00000100:00100000:3.0:1787786448.661769:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786448.661973:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667936896 00000100:00100000:0.0:1787786448.661983:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667936896 00000100:00100000:0.0:1787786448.662050:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 204 00000100:00100000:0.0:1787786448.662060:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+52:11620:x1874629667936896:12345-192.168.204.34@tcp:34:lfs.0 00010000:00010000:0.0:1787786448.662154:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2edf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.662171:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2edf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.662194:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2edf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.662210:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2ee6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.662217:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.662223:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.662335:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2eed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.662344:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2eed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.662352:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2eed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787786448.662394:0:7644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2eed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.662407:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2edf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.662414:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2edf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.662420:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2edf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.662436:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912c000 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786448.662440:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2edf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.662448:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2edf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.662460:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b5204e6f400) 00010000:00010000:0.0:1787786448.662463:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786448.662467:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2edf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.662473:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2edf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.662486:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.662491:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2ee6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.662496:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2ee6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.662501:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912dc00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786448.662504:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2ee6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.662510:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2ee6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.662527:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b5222ae8c00) 00010000:00010000:0.0:1787786448.662530:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786448.662533:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2ee6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.662538:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2ee6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.662552:0:7644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2eed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.662558:0:7644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2eed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.662563:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2eed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.662568:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912ce00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786448.662571:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2eed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.662576:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2eed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.662583:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5222ae8600) 00010000:00010000:0.0:1787786448.662585:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786448.662588:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2eed lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.662594:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2eed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786448.662671:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+52:11620:x1874629667936896:12345-192.168.204.34@tcp:34:lfs.0 Request processed in 612us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786448.662680:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 204 00000100:00100000:3.0:1787786448.708372:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786448.712023:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667937152 00000100:00100000:1.0:1787786448.712040:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667937152 00000100:00100000:0.0:1787786448.712285:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 205 00000100:00100000:0.0:1787786448.712297:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101372d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+52:11623:x1874629667937152:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1787786448.712322:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786448.712345:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2ef4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75252a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.712425:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2efb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.712699:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2efb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.712714:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2efb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.712732:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2f02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.712739:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.712745:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.712927:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2f09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.713161:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2f09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.713169:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2f09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787786448.713180:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787786448.713357:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2efb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.713365:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2efb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.713372:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2efb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.713379:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912dc00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786448.713384:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2efb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.713393:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2efb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.713406:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b5204e6f400) 00010000:00010000:0.0:1787786448.713409:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786448.713414:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2efb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.713421:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2efb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.713435:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2f02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.713661:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2f02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.713668:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2f02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.713672:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912c000 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786448.713675:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2f02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.713681:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2f02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.713689:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b5222ae8c00) 00010000:00010000:0.0:1787786448.713692:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786448.713694:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2f02 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.713699:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff2f02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.713747:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ce00/0x450132973bff2ef4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75252a expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.713760:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2f09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75252a expref: 54 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.713767:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5222ae8600) 00010000:00010000:0.0:1787786448.713770:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787786448.713976:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912da00, rc 0) 00000100:00100000:0.0:1787786448.714053:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101372d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+54:11623:x1874629667937152:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 1758us (5691us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1787786448.714062:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 205 00000100:00100000:1.0:1787786448.721380:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786448.721481:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667937280 00000100:00100000:3.0:1787786448.721491:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667937280 00000100:00100000:3.0:1787786448.721552:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 206 00000100:00100000:3.0:1787786448.721562:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+54:11623:x1874629667937280:12345-192.168.204.34@tcp:54:lfs.0 00010000:00010000:3.0:1787786448.721653:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2f17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.721670:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.721681:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.721714:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2f17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.721721:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2f17 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.721728:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2f17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.721734:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d4e00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786448.721738:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2f17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.721745:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2f17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.721758:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5222ae8600) 00010000:00010000:3.0:1787786448.721761:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787786448.721766:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2f17 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.721772:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2f17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786448.721971:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+54:11623:x1874629667937280:12345-192.168.204.34@tcp:54:lfs.0 Request processed in 409us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786448.721980:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 206 00000100:00100000:2.0:1787786448.725560:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786448.725656:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667937536 00000100:00100000:0.0:1787786448.725666:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667937536 00000100:00100000:0.0:1787786448.725723:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 58 00000100:00100000:0.0:1787786448.725733:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b510331e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+54:11623:x1874629667937536:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:0.0:1787786448.726015:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b510331e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+55:11623:x1874629667937536:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 283us (463us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1787786448.726024:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 58 00000100:00100000:2.0:1787786448.794307:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786448.794726:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667937792 00000100:00100000:1.0:1787786448.794742:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667937792 00000100:00100000:1.0:1787786448.794876:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 207 00000100:00100000:1.0:1787786448.794889:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b510331d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+55:11633:x1874629667937792:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:1.0:1787786448.794921:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786448.794925:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1787786448.794960:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2e99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75250e expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.794984:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b5204e6f400) 00010000:00010000:1.0:1787786448.794991:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787786448.795008:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff2f1e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752531 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.795150:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2f25 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.795168:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2f09 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75252a expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.795178:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2f25 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.795221:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2f09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75252a expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.795237:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2f09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75252a expref: 55 pid: 5846 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786448.795274:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5101ab83c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874629686798720:192.168.204.34@tcp:104: 00000100:00100000:1.0:1787786448.795558:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b4becc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787786448.803488:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5101ab83c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1874629686798720:192.168.204.34@tcp:104: 00010000:00010000:2.0:1787786448.803541:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2f25 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786448.805194:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786448.805832:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667937920 00000100:00100000:3.0:1787786448.805845:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667937920 00010000:00010000:3.0:1787786448.805958:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2f09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75252a expref: 56 pid: 5846 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786448.806046:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 79 00000100:00100000:3.0:1787786448.806057:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b510331e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+56:2364:x1874629667937920:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787786448.806078:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786448.806086:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2f09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75252a expref: 56 pid: 5846 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.806102:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2f09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75252a expref: 56 pid: 5846 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.806130:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2f09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75252a expref: 56 pid: 5846 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.806150:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5222ae8600) 00010000:00010000:3.0:1787786448.806155:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2f25 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.806167:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2f25 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.806191:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2f25 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.806234:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787786448.806322:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b510331e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+55:2364:x1874629667937920:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 265us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786448.806330:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 79 00010000:00010000:1.0:1787786448.806576:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2f25 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.806588:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2f25 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787786448.806612:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787786448.807021:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff2f1e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752531 expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.807042:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2f25 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752531 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.807051:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5222ae8600) 00010000:00010000:1.0:1787786448.807055:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787786448.807058:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523b4d9400, rc 0) 00000100:00100000:1.0:1787786448.807147:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b510331d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+55:11633:x1874629667937792:12345-192.168.204.34@tcp:101:bash.0 Request processed in 12260us (12855us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1787786448.807157:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 207 00000100:00100000:2.0:1787786448.809944:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786448.810419:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667938176 00000100:00100000:0.0:1787786448.810437:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667938176 00000100:00100000:0.0:1787786448.810610:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 208 00000100:00100000:0.0:1787786448.810623:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b510331c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+55:11633:x1874629667938176:12345-192.168.204.34@tcp:36:bash.0 00010000:00010000:0.0:1787786448.811462:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2f33 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.811546:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2f33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.811561:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2f33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787786448.811635:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1787786448.811668:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec57b27b reply state 000000001780fba4 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2f33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786448.811678:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787786448.812965:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b510331c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+58:11633:x1874629667938176:12345-192.168.204.34@tcp:36:bash.0 Request processed in 2330us (3021us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1787786448.812978:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 208 00000020:00080000:0.0:1787786448.812987:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787786448.817465:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2f33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.817488:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2f33 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.817495:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2f33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.817501:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912dc00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786448.817507:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2f33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.817515:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2f33 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.817609:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5222ae8600) 00010000:00010000:3.0:1787786448.817613:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786448.817620:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2f33 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.817627:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff2f33 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786448.822661:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786448.822763:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667938304 00000100:00100000:0.0:1787786448.822825:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667938304 00000100:00100000:0.0:1787786448.822911:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 209 00000100:00100000:0.0:1787786448.822924:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b510331c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+57:11633:x1874629667938304:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:0.0:1787786448.822960:0:7644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786448.822988:0:7644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d600/0x450132973bff2f3a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752538 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.823123:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2f41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.823143:0:7644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2f25 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752531 expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.823153:0:7644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2f41 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.823202:0:7644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2f25 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752531 expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786448.823218:0:7644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2f25 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752531 expref: 58 pid: 5847 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786448.823233:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237a54b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7644:1874629686798848:192.168.204.34@tcp:104: 00000100:00100000:0.0:1787786448.823343:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52328bdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787786448.831565:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786448.831769:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667938432 00000100:00100000:3.0:1787786448.831832:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667938432 00010000:00010000:3.0:1787786448.831899:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2f25 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752531 expref: 59 pid: 5847 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786448.832017:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 80 00000100:00100000:3.0:1787786448.832030:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a54f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:173d08e0-0e54-474e-858e-1679cd38cf14+59:2364:x1874629667938432:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787786448.832052:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786448.832061:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2f25 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752531 expref: 59 pid: 5847 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.832077:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2f25 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752531 expref: 59 pid: 5847 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.832109:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5222ae8600) 00010000:00010000:3.0:1787786448.832115:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2f41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.832128:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2f41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.832137:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2f41 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.832163:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787786448.832232:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a54f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:173d08e0-0e54-474e-858e-1679cd38cf14+59:2364:x1874629667938432:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 204us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786448.832240:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 80 00010000:00010000:2.0:1787786448.834488:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2f25 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752531 expref: 58 pid: 5847 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786448.834524:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237a54b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7644:1874629686798848:192.168.204.34@tcp:104: 00010000:00010000:2.0:1787786448.834559:0:7644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2f41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.834571:0:7644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2f41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.834577:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2f41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786448.834641:0:7644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787786448.834646:0:7644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787786448.834673:0:7644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2f41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.834716:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d600/0x450132973bff2f3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752538 expref: 58 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.834732:0:7644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2f41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752538 expref: 57 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.834742:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5222ae8600) 00010000:00010000:2.0:1787786448.834745:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787786448.834749:0:7644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912da00, rc 0) 00000100:00100000:2.0:1787786448.834887:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b510331c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+57:11633:x1874629667938304:12345-192.168.204.34@tcp:101:bash.0 Request processed in 11965us (12240us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786448.834914:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 209 00000100:00100000:0.0:1787786448.839087:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786448.839196:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667938688 00000100:00100000:2.0:1787786448.839210:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667938688 00000100:00100000:2.0:1787786448.839383:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 59 00000100:00100000:2.0:1787786448.839396:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a56580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+57:11633:x1874629667938688:12345-192.168.204.34@tcp:35:bash.0 00000100:00100000:2.0:1787786448.839866:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a56580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+58:11633:x1874629667938688:12345-192.168.204.34@tcp:35:bash.0 Request processed in 465us (786us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1787786448.839876:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 59 00000100:00100000:0.0:1787786448.927178:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786448.927303:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667938816 00000100:00100000:1.0:1787786448.927314:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667938816 00000100:00100000:1.0:1787786448.927385:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 210 00000100:00100000:1.0:1787786448.927745:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a55680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+58:11639:x1874629667938816:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:1.0:1787786448.927917:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786448.927953:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff2f48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75253f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.928023:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2f4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.928038:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2f4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.928050:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2f4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787786448.928110:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787786448.928113:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787786448.928136:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2f4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.928161:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff2f48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75253f expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.928179:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2f4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75253f expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.928187:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b5204e6f400) 00010000:00010000:1.0:1787786448.928190:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787786448.928193:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523b4d8c00, rc 0) 00000100:00100000:1.0:1787786448.929959:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a55680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+59:11639:x1874629667938816:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 2379us (2606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786448.929971:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 210 00000100:00100000:0.0:1787786448.939630:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786448.940844:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667938944 00000100:00100000:2.0:1787786448.940857:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667938944 00000100:00100000:2.0:1787786448.940972:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 211 00000100:00100000:2.0:1787786448.940983:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+59:11639:x1874629667938944:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:2.0:1787786448.941003:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786448.941024:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2f56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752546 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.941093:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff2f5d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.941107:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff2f5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.941118:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff2f5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.941133:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2f64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.941158:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2f64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.941164:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2f64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.941283:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2f6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.941292:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2f6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.941299:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2f6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786448.941332:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787786448.941346:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787786448.941367:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2f6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.941379:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2f6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.941386:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff2f5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.941392:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff2f5d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.943739:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff2f5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.943767:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aac200 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786448.943783:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff2f5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.943808:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff2f5d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.943826:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b5204e6f400) 00010000:00010000:2.0:1787786448.943829:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786448.943835:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff2f5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.943842:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff2f5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.943863:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2f64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.943869:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2f64 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.943876:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2f64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.943881:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aaca00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786448.943884:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2f64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.943891:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2f64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.943908:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b5210c81e00) 00010000:00010000:2.0:1787786448.943911:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786448.943914:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2f64 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.943920:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2f64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.943969:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2f56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752546 expref: 61 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.943982:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2f6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752546 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.943989:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5222ae8600) 00010000:00010000:2.0:1787786448.943992:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787786448.943994:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aad000, rc 0) 00000100:00100000:2.0:1787786448.944085:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a561c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+60:11639:x1874629667938944:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 3102us (4462us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786448.944094:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 211 00000100:00100000:0.0:1787786448.950125:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786448.951988:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667939200 00000100:00100000:3.0:1787786448.952002:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667939200 00000100:00100000:3.0:1787786448.952077:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 212 00000100:00100000:3.0:1787786448.952088:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a57840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+60:11639:x1874629667939200:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:3.0:1787786448.952110:0:7644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786448.952132:0:7644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2f72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75254d expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.952230:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2f79 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.952244:0:7644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2f41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752538 expref: 61 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.952253:0:7644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2f6b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752546 expref: 61 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.952262:0:7644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2f79 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.952294:0:7644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2f6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752546 expref: 61 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.952307:0:7644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2f6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752546 expref: 61 pid: 5846 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786448.952321:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b51013703c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7644:1874629686798976:192.168.204.34@tcp:104: 00010000:00010000:3.0:1787786448.952495:0:7644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2f41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752538 expref: 61 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.952517:0:7644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2f41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752538 expref: 61 pid: 7644 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786448.952526:0:7644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b51013712c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7644:1874629686799104:192.168.204.34@tcp:104: 00000100:00100000:3.0:1787786448.952550:0:7644:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5102c4bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1787786448.954426:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786448.954508:0:8508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667939328 00000100:00100000:2.0:1787786448.954517:0:8508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667939328 00010000:00010000:2.0:1787786448.954553:0:8508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2f6b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752546 expref: 62 pid: 5846 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786448.954593:0:8508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 81 00000100:00100000:2.0:1787786448.954603:0:8508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5211bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:173d08e0-0e54-474e-858e-1679cd38cf14+62:2364:x1874629667939328:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787786448.954629:0:8508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787786448.954636:0:8508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2f6b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752546 expref: 62 pid: 5846 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.954651:0:8508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2f6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752546 expref: 62 pid: 5846 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.954682:0:8508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5222ae8600) 00010000:00010000:2.0:1787786448.954688:0:8508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2f79 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.954696:0:8508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2f79 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.954703:0:8508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787786448.954754:0:8508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5211bfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:173d08e0-0e54-474e-858e-1679cd38cf14+62:2364:x1874629667939328:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 152us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786448.954761:0:8508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 81 00010000:00010000:3.0:1787786448.959942:0:7644:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.34@tcp) returned -22 from blocking AST (req@000000003cf49e5f x1874629686798976) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2f6b lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752546 expref: 61 pid: 5846 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.959969:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2f6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752546 expref: 61 pid: 5846 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786448.959985:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b51013703c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7644:1874629686798976:192.168.204.34@tcp:104: 00000100:00100000:3.0:1787786448.960000:0:7644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b51013712c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7644:1874629686799104:192.168.204.34@tcp:104: 00010000:00010000:3.0:1787786448.960025:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5222ae8600) 00010000:00010000:3.0:1787786448.960032:0:7644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2f79 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.960041:0:7644:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2f79 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.960050:0:7644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2f79 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786448.961737:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786448.961923:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667939456 00000100:00100000:3.0:1787786448.961933:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667939456 00010000:00010000:3.0:1787786448.961983:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2f41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752538 expref: 61 pid: 7644 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786448.962053:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 82 00000100:00100000:3.0:1787786448.962062:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101ab9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+61:2365:x1874629667939456:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787786448.962076:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786448.962083:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2f41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752538 expref: 61 pid: 7644 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.962096:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2f41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752538 expref: 61 pid: 7644 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.962118:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912da00/0x450132973bff2f41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752538 expref: 61 pid: 7644 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.962133:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5222ae8600) 00010000:00010000:3.0:1787786448.962138:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2f79 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.962147:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2f79 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.962154:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2f79 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.962191:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787786448.962356:0:7644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2f79 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.962364:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2f79 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786448.962382:0:7644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787786448.962525:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2f72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75254d expref: 62 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.962542:0:7644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2f79 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75254d expref: 61 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786448.962556:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5222ae8600) 00010000:00010000:2.0:1787786448.962559:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787786448.962561:0:7644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d4a00, rc 0) 00000100:00100000:3.0:1787786448.962603:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101ab9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+61:2365:x1874629667939456:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 542us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786448.962611:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 82 00000100:00100000:2.0:1787786448.964972:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a57840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+60:11639:x1874629667939200:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 12874us (14845us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1787786448.964985:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 212 00000100:00100000:0.0:1787786448.972957:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786448.973033:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667939712 00000100:00100000:3.0:1787786448.973047:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667939712 00000100:00100000:3.0:1787786448.973108:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 16 00000100:00100000:3.0:1787786448.973118:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a57c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:173d08e0-0e54-474e-858e-1679cd38cf14+60:11639:x1874629667939712:12345-192.168.204.34@tcp:103:lfs.0 00010000:00010000:3.0:1787786448.973134:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786448.973158:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff2ed8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752523 expref: 60 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.973191:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5222ae8600) 00010000:00010000:3.0:1787786448.973195:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787786448.973255:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a57c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:173d08e0-0e54-474e-858e-1679cd38cf14+59:11639:x1874629667939712:12345-192.168.204.34@tcp:103:lfs.0 Request processed in 138us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786448.973262:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 16 00000100:00100000:0.0:1787786448.984829:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786448.985072:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667939840 00000100:00100000:1.0:1787786448.985083:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667939840 00000100:00100000:1.0:1787786448.985149:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 213 00000100:00100000:1.0:1787786448.985159:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a56940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+59:11639:x1874629667939840:12345-192.168.204.34@tcp:58:lfs.0 00010000:00010000:1.0:1787786448.985425:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff2f87 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.985443:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff2f87 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786448.985455:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff2f87 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787786448.985880:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1787786448.985962:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a56940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+59:11639:x1874629667939840:12345-192.168.204.34@tcp:58:lfs.0 Request processed in 803us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786448.985971:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 213 00000100:00100000:1.0:1787786448.996465:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786448.996647:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667939968 00000100:00100000:3.0:1787786448.996657:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667939968 00000100:00100000:3.0:1787786448.996781:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 214 00000100:00100000:3.0:1787786448.996813:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101ab92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+59:11639:x1874629667939968:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:3.0:1787786448.996837:0:8713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786448.996859:0:8713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2f8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752554 expref: -99 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.996914:0:8713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff2f87 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.996925:0:8713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2f8e lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752554 expref: 60 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.996944:0:8713:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff2f87 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.996970:0:8713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2f8e lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752554 expref: 60 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.996985:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5222ae8600) 00010000:00010000:3.0:1787786448.996988:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787786448.996991:0:8713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2f8e lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752554 expref: 60 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786448.996999:0:8713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d5600, rc 0) 00000100:00100000:3.0:1787786448.997070:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101ab92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+60:11639:x1874629667939968:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 280us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786448.997078:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 214 00010000:00010000:3.0:1787786449.353983:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787786449.802165:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787786449.802174:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787786449.802219:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1787786449.802225:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787786449.802366:0:11693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5101abad00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874629686799232:192.168.204.34@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787786449.802494:0:11693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b4be6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787786449.807329:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786449.807640:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667940096 00000100:00100000:2.0:1787786449.807651:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667940096 00000100:00100000:2.0:1787786449.807734:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 215 00000100:00100000:2.0:1787786449.807746:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101abb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+61:11640:x1874629667940096:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787786449.807840:0:7644:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787786449.807961:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101abb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+61:11640:x1874629667940096:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 Request processed in 216us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786449.807969:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 215 00000100:00080000:3.0:1787786449.808151:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787786449.808880:0:11693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5101abad00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874629686799232:192.168.204.34@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787786449.819452:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786449.819864:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667940224 00000100:00100000:1.0:1787786449.819875:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667940224 00000100:00100000:1.0:1787786449.819939:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 216 00000100:00100000:1.0:1787786449.819966:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a55a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+60:11640:x1874629667940224:12345-192.168.204.34@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787786449.820042:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2f95 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.820059:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2f95 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.820073:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2f95 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.820090:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff2f9c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.820099:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff2f9c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.820105:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff2f9c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.820128:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2fa3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.820137:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.820143:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787786449.820183:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1787786449.820188:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787786449.820201:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.820226:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2f95 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.820232:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2f95 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.820239:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2f95 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.820246:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8a00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786449.820250:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2f95 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.820259:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2f95 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.820271:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b5210c81800) 00010000:00010000:1.0:1787786449.820274:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787786449.820278:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2f95 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.820285:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8a00/0x450132973bff2f95 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.820298:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff2f9c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.820304:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff2f9c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.820327:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff2f9c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.820339:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d9c00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786449.820343:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff2f9c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.820349:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff2f9c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.820357:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8b52100f1300) 00010000:00010000:1.0:1787786449.820359:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787786449.820362:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff2f9c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.820369:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff2f9c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.820384:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.820390:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2fa3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.820396:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.820401:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d9400 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786449.820403:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.820409:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2fa3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.820428:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5222ae8600) 00010000:00010000:1.0:1787786449.820431:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787786449.820435:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2fa3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.820441:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2fa3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786449.820527:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a55a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+60:11640:x1874629667940224:12345-192.168.204.34@tcp:34:lhsmtool_posix.0 Request processed in 563us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786449.820536:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 216 00000100:00100000:2.0:1787786449.823001:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786449.823345:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667940480 00000100:00100000:3.0:1787786449.823356:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667940480 00000100:00100000:3.0:1787786449.823411:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 217 00000100:00100000:3.0:1787786449.823422:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b510331e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+60:11640:x1874629667940480:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787786449.823442:0:8713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786449.823464:0:8713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2faa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75255b expref: -99 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.823584:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2fb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.823599:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.823623:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786449.823636:0:8713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787786449.823736:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.823744:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2fb1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.823750:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2fb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.823770:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d5c00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786449.823775:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2fb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.823782:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2fb1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.823831:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5222ae8600) 00010000:00010000:3.0:1787786449.823835:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787786449.823848:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2fb1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.823854:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2fb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.823895:0:8713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2faa lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75255b expref: 62 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.823918:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b5210c81800) 00010000:00010000:3.0:1787786449.823921:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787786449.823926:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2faa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75255b expref: 62 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.823937:0:8713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d4e00, rc 0) 00000100:00100000:3.0:1787786449.823996:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b510331e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+61:11640:x1874629667940480:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 576us (1004us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1787786449.824004:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 217 00000100:00100000:0.0:1787786449.828898:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786449.829012:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667940608 00000100:00100000:1.0:1787786449.829023:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667940608 00000100:00100000:1.0:1787786449.829086:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 218 00000100:00100000:1.0:1787786449.829095:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+61:11640:x1874629667940608:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787786449.829132:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787786449.829231:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+61:11640:x1874629667940608:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 Request processed in 136us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786449.829239:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 218 00000100:00100000:0.0:1787786449.835290:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786449.835709:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667940864 00000100:00100000:2.0:1787786449.835720:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667940864 00000100:00100000:2.0:1787786449.835821:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 219 00000100:00100000:2.0:1787786449.835832:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+61:11640:x1874629667940864:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787786449.835861:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786449.835865:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787786449.835893:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8c00/0x450132973bff2f4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75253f expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.835910:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b5204e6f400) 00010000:00010000:2.0:1787786449.835929:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787786449.835945:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2fbf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752562 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787786449.836400:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1787786449.836599:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff2fc6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.836613:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff2fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.836624:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff2fc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.836674:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2fbf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752562 expref: 63 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.836689:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff2fc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752562 expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.836697:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8b5210c81e00) 00010000:00010000:2.0:1787786449.836700:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787786449.836702:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aac200, rc 0) 00000100:00100000:2.0:1787786449.836785:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+62:11640:x1874629667940864:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 955us (1505us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1787786449.837137:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 219 00000100:00100000:0.0:1787786449.840484:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786449.840642:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667941120 00000100:00100000:3.0:1787786449.840652:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667941120 00000100:00100000:3.0:1787786449.840713:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 220 00000100:00100000:3.0:1787786449.840723:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+62:11640:x1874629667941120:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787786449.840820:0:8713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786449.840860:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac200/0x450132973bff2fc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752562 expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.840880:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8b5210c81e00) 00010000:00010000:3.0:1787786449.840891:0:8713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787786449.840914:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2fd4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.840929:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2fd4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.840938:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2fd4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.841036:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2fdb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x10016ebc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.841045:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2fdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x10016ebc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.841051:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2fdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x10016ebc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.841128:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2fd4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.841137:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2fd4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.841144:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2fd4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.841151:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d4e00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786449.841155:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2fd4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.841163:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2fd4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.841173:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b5204e6f400) 00010000:00010000:3.0:1787786449.841176:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786449.841180:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2fd4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.841186:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff2fd4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.841203:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2fdb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x10016ebc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.841210:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2fdb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x10016ebc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.841216:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2fdb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x10016ebc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.841221:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d5c00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786449.841224:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2fdb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x10016ebc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.841230:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2fdb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x10016ebc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.841238:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x10016ebc (ffff8b5204e6fe00) 00010000:00010000:3.0:1787786449.841240:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786449.841243:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2fdb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x10016ebc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.841249:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff2fdb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x10016ebc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786449.841354:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+61:11640:x1874629667941120:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 Request processed in 632us (879us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787786449.841362:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 220 00000100:00100000:0.0:1787786449.843486:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786449.843526:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786449.843556:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786449.843592:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786449.843654:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667941248 00000100:00100000:2.0:1787786449.843664:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667941248 00000100:00100000:2.0:1787786449.843714:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 291 00000100:00100000:2.0:1787786449.843725:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2365:x1874629667941248:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786449.843850:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2365:x1874629667941248:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 126us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786449.843858:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 291 00000100:00100000:2.0:1787786449.843892:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667941632 00000100:00100000:2.0:1787786449.843896:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667941632 00000100:00080000:2.0:1787786449.843918:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787786449.843946:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 146 00000100:00100000:2.0:1787786449.843967:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a56d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e407027-7940-45d9-87d7-56031cd08b7a+5:2364:x1874629667941632:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786449.844000:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a56d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e407027-7940-45d9-87d7-56031cd08b7a+5:2364:x1874629667941632:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 34us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786449.844007:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 146 00000100:00100000:1.0:1787786449.844165:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667941376 00000100:00100000:1.0:1787786449.844170:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667941376 00000100:00100000:1.0:1787786449.844214:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667941504 00000100:00100000:1.0:1787786449.844217:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667941504 00000100:00100000:1.0:1787786449.844239:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 87 00000100:00100000:1.0:1787786449.844252:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a55e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:173d08e0-0e54-474e-858e-1679cd38cf14+9:2364:x1874629667941376:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1787786449.844282:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a55e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:173d08e0-0e54-474e-858e-1679cd38cf14+9:2364:x1874629667941376:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 32us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786449.844299:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 87 00000100:00100000:1.0:1787786449.844331:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 88 00000100:00100000:1.0:1787786449.844338:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:173d08e0-0e54-474e-858e-1679cd38cf14+7:2365:x1874629667941504:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1787786449.844365:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:173d08e0-0e54-474e-858e-1679cd38cf14+7:2365:x1874629667941504:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 27us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786449.844371:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 88 00000100:00080000:2.0:1787786449.844509:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787786449.845529:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786449.845606:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667941760 00000100:00100000:2.0:1787786449.845613:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667941760 00000100:00100000:2.0:1787786449.845655:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 221 00000100:00100000:2.0:1787786449.845664:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a54f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+61:11640:x1874629667941760:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787786449.845680:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786449.845702:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2fe2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752569 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.845739:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2fe9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.845751:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.845773:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2fe9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.845920:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2fe2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752569 expref: 63 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.845938:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752569 expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.845947:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8b5210c81700) 00010000:00010000:2.0:1787786449.845950:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787786449.845954:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aad200, rc 0) 00000100:00100000:2.0:1787786449.846005:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a54f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+62:11640:x1874629667941760:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 342us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786449.846012:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 221 00000100:00100000:0.0:1787786449.849970:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786449.850046:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667942016 00000100:00100000:1.0:1787786449.850057:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667942016 00000100:00100000:1.0:1787786449.850151:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 222 00000100:00100000:1.0:1787786449.850163:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a54b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+62:11640:x1874629667942016:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787786449.850260:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2ff0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.850280:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2ff0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.850291:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2ff0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787786449.850565:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:1.0:1787786449.850576:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 376208784528ns, next at 377208781221ns, rc = 0 00000004:00010000:1.0:1787786449.850660:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d07f9bfb reply state 00000000a3abb15d transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2ff0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786449.850670:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787786449.850991:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a54b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+64:11640:x1874629667942016:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 Request processed in 626us (827us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1787786449.851020:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 222 00010000:00010000:2.0:1787786449.853065:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2ff0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.853081:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2ff0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.853089:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2ff0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.853095:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d9400 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786449.853101:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2ff0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.853110:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2ff0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.853129:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8b5210c81700) 00010000:00010000:2.0:1787786449.853145:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787786449.853151:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2ff0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.853158:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff2ff0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786449.854696:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786449.855073:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667942144 00000100:00100000:2.0:1787786449.855084:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667942144 00000100:00100000:2.0:1787786449.855140:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 223 00000100:00100000:2.0:1787786449.855150:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101be92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+63:11640:x1874629667942144:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787786449.855176:0:7644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786449.855197:0:7644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2ff7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752570 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.855277:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2ff7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752570 expref: 64 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.855292:0:7644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2ff7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752570 expref: 64 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.855321:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8b5210c81700) 00010000:00010000:2.0:1787786449.855324:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787786449.855326:0:7644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aad000, rc 0) 00000100:00100000:2.0:1787786449.855392:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101be92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+64:11640:x1874629667942144:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 243us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786449.855400:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 223 00000100:00100000:0.0:1787786449.863082:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786449.863255:0:12026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667942272 00000100:00100000:2.0:1787786449.863266:0:12026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667942272 00000100:00100000:2.0:1787786449.863333:0:12026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 62 00000100:00100000:2.0:1787786449.863342:0:12026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101bead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:173d08e0-0e54-474e-858e-1679cd38cf14+9:2362:x1874629667942272:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787786449.863639:0:12026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101bead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:173d08e0-0e54-474e-858e-1679cd38cf14+10:2362:x1874629667942272:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 Request processed in 297us (567us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1787786449.863648:0:12026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 62 00000100:00100000:3.0:1787786449.869216:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786449.869608:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667942528 00000100:00100000:0.0:1787786449.869618:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667942528 00000100:00100000:0.0:1787786449.869682:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 60 00000100:00100000:0.0:1787786449.869694:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b51013712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+64:11640:x1874629667942528:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787786449.870156:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b51013712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+65:11640:x1874629667942528:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 Request processed in 464us (948us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1787786449.870165:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 60 00000100:00100000:0.0:1787786449.872956:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786449.873041:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667942784 00000100:00100000:3.0:1787786449.873051:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667942784 00000100:00100000:3.0:1787786449.873174:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 224 00000100:00100000:3.0:1787786449.873184:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101beb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+65:11640:x1874629667942784:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787786449.873645:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101beb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+65:11640:x1874629667942784:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 460us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786449.873656:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 224 00000100:00100000:1.0:1787786449.876625:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786449.876705:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667942912 00000100:00100000:2.0:1787786449.876715:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667942912 00000100:00100000:2.0:1787786449.876856:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 225 00000100:00100000:2.0:1787786449.876866:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101ab8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+65:11640:x1874629667942912:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787786449.876886:0:7644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786449.876906:0:7644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2ffe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752577 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.876974:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff3005 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.876988:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff3005 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.876999:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff3005 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786449.877034:0:7644:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787786449.877055:0:7644:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff3005 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.877080:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aaca00/0x450132973bff2ffe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752577 expref: 67 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.877117:0:7644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff3005 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752577 expref: 66 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.877125:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8b5210c81700) 00010000:00010000:2.0:1787786449.877127:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787786449.877130:0:7644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aad800, rc 0) 00000100:00100000:2.0:1787786449.877197:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101ab8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+66:11640:x1874629667942912:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 332us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786449.877204:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 225 00000100:00100000:3.0:1787786449.879596:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786449.879870:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667943040 00000100:00100000:1.0:1787786449.879880:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667943040 00000100:00100000:1.0:1787786449.879938:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 63 00000100:00100000:1.0:1787786449.879948:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b51013703c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+10:2364:x1874629667943040:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787786449.879966:0:8126:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786449.879985:0:8126:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd92afd2/0x450132973bff300c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75257e expref: -99 pid: 8126 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787786449.880012:0:8126:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f74d1, blocks: 0x1 00010000:00010000:1.0:1787786449.880031:0:8126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=376s v=(0 0) 00010000:00010000:1.0:1787786449.880036:0:8126:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786449.880046:0:8126:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd92afd2/0x450132973bff300c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75257e expref: 11 pid: 8126 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.880063:0:8126:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bd92afd2/0x450132973bff300c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75257e expref: 11 pid: 8126 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.880077:0:8126:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523b4d8200, rc 0) 00000100:00100000:1.0:1787786449.880135:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b51013703c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+11:2364:x1874629667943040:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 187us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786449.880142:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 63 00000100:00100000:0.0:1787786449.883259:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786449.883515:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667943296 00000100:00100000:2.0:1787786449.883525:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667943296 00000100:00100000:2.0:1787786449.883621:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 226 00000100:00100000:2.0:1787786449.883631:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101be8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+66:11640:x1874629667943296:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787786449.883915:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101be8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+66:11640:x1874629667943296:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 285us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786449.883922:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 226 00000100:00100000:1.0:1787786449.886367:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786449.886659:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667943424 00000100:00100000:3.0:1787786449.886669:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667943424 00000100:00100000:3.0:1787786449.886721:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 64 00000100:00100000:3.0:1787786449.886731:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101ab8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+11:11640:x1874629667943424:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787786449.886749:0:6699:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786449.886777:0:6699:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000377b8f78/0x450132973bff3013 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752585 expref: -99 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.886879:0:6699:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd92afd2/0x450132973bff300c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75257e expref: 12 pid: 8126 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.886890:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787786449.886894:0:6699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787786449.886899:0:6699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000377b8f78/0x450132973bff3013 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752585 expref: 12 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.886932:0:6699:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bd92afd2/0x450132973bff300c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75257e expref: 12 pid: 8126 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.886945:0:6699:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bd92afd2/0x450132973bff300c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75257e expref: 12 pid: 8126 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786449.886976:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5101373480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6699:1874629686799360:192.168.204.34@tcp:104: 00000100:00100000:3.0:1787786449.887075:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5102c4ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787786449.890747:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786449.890876:0:11675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667943552 00000100:00100000:1.0:1787786449.890901:0:11675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667943552 00010000:00010000:1.0:1787786449.890946:0:11675:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bd92afd2/0x450132973bff300c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75257e expref: 13 pid: 8126 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786449.890998:0:11675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 83 00000100:00100000:1.0:1787786449.891009:0:11675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101be8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:173d08e0-0e54-474e-858e-1679cd38cf14+13:2365:x1874629667943552:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787786449.891025:0:11675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786449.891049:0:11675:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bd92afd2/0x450132973bff300c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75257e expref: 13 pid: 8126 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.891063:0:11675:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bd92afd2/0x450132973bff300c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75257e expref: 13 pid: 8126 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.891093:0:11675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786449.891098:0:11675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786449.891106:0:11675:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000377b8f78/0x450132973bff3013 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752585 expref: 13 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.891117:0:11675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000377b8f78/0x450132973bff3013 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752585 expref: 13 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786449.891156:0:11675:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000377b8f78/0x450132973bff3013 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752585 expref: 13 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786449.891172:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5101ab8f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11675:1874629686799488:192.168.204.34@tcp:105: 00000100:00100000:1.0:1787786449.891358:0:11675:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b4beb40 going to sleep for 11 seconds 00010000:00010000:3.0:1787786449.892360:0:6699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd92afd2/0x450132973bff300c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75257e expref: 13 pid: 8126 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786449.892378:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5101373480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6699:1874629686799360:192.168.204.34@tcp:104: 00010000:00010000:3.0:1787786449.892404:0:6699:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000377b8f78/0x450132973bff3013 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752585 expref: 12 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.892416:0:6699:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d5800, rc 0) 00000100:00100000:3.0:1787786449.892466:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101ab8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+12:11640:x1874629667943424:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 5736us (6109us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786449.892475:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 64 00000100:00100000:0.0:1787786449.898329:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786449.898467:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5101ab8f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11675:1874629686799488:192.168.204.34@tcp:105: 00010000:00010000:1.0:1787786449.898499:0:11675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786449.898554:0:11675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101be8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:173d08e0-0e54-474e-858e-1679cd38cf14+11:2365:x1874629667943552:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 7547us (7818us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786449.898566:0:11675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 83 00000100:00100000:2.0:1787786449.899221:0:6706:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667943680 00000100:00100000:2.0:1787786449.899230:0:6706:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667943680 00002000:00100000:0.0:1787786449.899413:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8b5101be8f00 x1874629667943680/t0(0) o4->173d08e0-0e54-474e-858e-1679cd38cf14@192.168.204.34@tcp:65/0 lens 504/0 e 0 to 0 dl 1787786460 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787786449.899424:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8b5101be8f00 with x1874629667943680 ext(0->12) 00002000:00010000:0.0:1787786449.899429:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b5101be8f00 00000100:00100000:0.0:1787786449.899500:0:6706:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 6 00000100:00100000:0.0:1787786449.899510:0:6706:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101be8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:173d08e0-0e54-474e-858e-1679cd38cf14+11:2365:x1874629667943680:12345-192.168.204.34@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787786449.900160:0:6706:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101be8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:173d08e0-0e54-474e-858e-1679cd38cf14+13:2365:x1874629667943680:12345-192.168.204.34@tcp:4:lhsmtool_posix.0 Request processed in 648us (1837us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1787786449.900170:0:6706:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 6 00002000:00100000:0.0:1787786449.900177:0:6706:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8b5101be8f00 x1874629667943680/t4294967320(0) o4->173d08e0-0e54-474e-858e-1679cd38cf14@192.168.204.34@tcp:65/0 lens 504/448 e 0 to 0 dl 1787786460 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787786449.900186:0:6706:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8b5101be8f00 with x1874629667943680 ext(0->12) 00002000:00010000:0.0:1787786449.900189:0:6706:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b5101be8f00 00000100:00100000:0.0:1787786449.903931:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786449.904015:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667943808 00000100:00100000:3.0:1787786449.904025:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667943808 00000100:00100000:3.0:1787786449.904086:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 227 00000100:00100000:3.0:1787786449.904095:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101bea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+66:11640:x1874629667943808:12345-192.168.204.34@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1787786449.942365:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1787786449.942413:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:2.0:1787786449.942445:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:2.0:1787786449.942461:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b523b4be180 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1787786449.942467:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8b523329ae00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b523b4bed80 00000020:00080000:2.0:1787786449.942474:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8b523329a700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b5215062c00 00000004:00080000:2.0:1787786449.942498:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1787786449.942534:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b5203e75d80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1787786449.942538:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8b523058b100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b5203e75e40 00000020:00080000:2.0:1787786449.942540:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8b523058b600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b523bee7000 00000020:00080000:2.0:1787786449.942586:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1787786449.942818:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1787786449.942939:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b510331e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686799616:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787786449.943028:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786449.943094:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686799616 00000100:00100000:2.0:1787786449.943102:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686799616 00000100:00100000:2.0:1787786449.943155:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787786449.943165:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5207200050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1874629686799616:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787786449.943197:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:2.0:1787786449.943231:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8f74d0, atime: 0x6a8f74d0, ctime: 0x6a8f74d0, blocks: 0x1 00010000:00010000:2.0:1787786449.943240:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cf621a0/0x450132973bff301a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.943257:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=376s v=(0 0) 00010000:00010000:2.0:1787786449.943263:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787786449.943270:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cf621a0/0x450132973bff301a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.943286:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cf621a0/0x450132973bff301a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.943296:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cf621a0/0x450132973bff301a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786449.943305:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101bea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+20:11640:x1874629667943808:12345-192.168.204.34@tcp:44:lhsmtool_posix.0 Request processed in 39206us (39380us total) trans 0 rc 0/0 00010000:00010000:2.0:1787786449.943321:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cf621a0/0x450132973bff301a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.943338:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787786449.943397:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 227 00000100:00100000:3.0:1787786449.943610:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5101373c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686799872:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787786449.943785:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5207200050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1874629686799616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 621us (760us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1787786449.943814:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787786449.943852:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786449.943959:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686799872 00000100:00100000:3.0:1787786449.943962:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787786449.943964:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686799872 00000100:00100000:3.0:1787786449.943971:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5101373480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686799744:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787786449.943998:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787786449.944004:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786449.944012:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b51013703c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1874629686799872:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1787786449.944035:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686799744 00000100:00100000:3.0:1787786449.944040:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686799744 00002000:00010000:2.0:1787786449.944116:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787786449.944121:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787786449 00002000:00010000:2.0:1787786449.944123:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787786449.944126:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787786449 -> 1787786449 00002000:00010000:2.0:1787786449.944129:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787786449.944133:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787786449.944142:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101371680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3314:x1874629686799744:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1787786449.944156:0:6700:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1787786449.944170:0:6700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089ad9383/0x450132973bff3021 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786449.944171:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b51013703c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3314:x1874629686799872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 160us (319us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1787786449.944187:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:3.0:1787786449.944196:0:6700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000021cd2b12/0x450132973bff2ddc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524e4 expref: 12 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.944206:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00000100:00080000:2.0:1787786449.944208:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787786449.944210:0:6700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00000100:00080000:2.0:1787786449.944214:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787786449.944216:0:6700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089ad9383/0x450132973bff3021 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.944224:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787786449.944232:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cf621a0/0x450132973bff301a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.944242:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aaca00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:3.0:1787786449.944245:0:6700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000021cd2b12/0x450132973bff2ddc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524e4 expref: 12 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.944257:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cf621a0/0x450132973bff301a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.944264:0:6700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000021cd2b12/0x450132973bff2ddc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524e4 expref: 12 pid: 12026 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.944273:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cf621a0/0x450132973bff301a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786449.944279:0:6700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5101373840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6700:1874629686800000:192.168.204.34@tcp:104: 00010000:00010000:2.0:1787786449.944299:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cf621a0/0x450132973bff301a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.944308:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cf621a0/0x450132973bff301a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.944326:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786449.944328:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786449.944330:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787786449.944365:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b510331e1c0/2, rc 0, transno 4294967310 00000100:00100000:2.0:1787786449.944371:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b510331e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686799616:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787786449.944492:0:6700:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5102c4ba80 going to sleep for 11 seconds 00000004:00080000:3.0:1787786449.944526:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b5101373c00/2, rc 0, transno 4294967321 00000100:00100000:3.0:1787786449.944531:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5101373c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686799872:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787786449.946577:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786449.946740:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667943936 00000100:00100000:1.0:1787786449.946749:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667943936 00000100:00100000:0.0:1787786449.948291:0:6700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5101373840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6700:1874629686800000:192.168.204.34@tcp:104: 00010000:00010000:0.0:1787786449.948321:0:6700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000089ad9383/0x450132973bff3021 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786449.949488:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786449.949834:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667944064 00000100:00100000:3.0:1787786449.949845:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667944064 00010000:00010000:2.0:1787786449.950095:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000021cd2b12/0x450132973bff2ddc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524e4 expref: 14 pid: 12026 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786449.950102:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 68 00000100:00100000:1.0:1787786449.950113:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101be9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:173d08e0-0e54-474e-858e-1679cd38cf14+14:2364:x1874629667943936:12345-192.168.204.34@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1787786449.950209:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 84 00000100:00100000:2.0:1787786449.950219:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101bea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+14:2364:x1874629667944064:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787786449.950232:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787786449.950238:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000021cd2b12/0x450132973bff2ddc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524e4 expref: 14 pid: 12026 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.950266:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000021cd2b12/0x450132973bff2ddc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524e4 expref: 14 pid: 12026 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.950290:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021cd2b12/0x450132973bff2ddc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524e4 expref: 14 pid: 12026 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.950823:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787786449.950831:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787786449.950838:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000089ad9383/0x450132973bff3021 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.950850:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089ad9383/0x450132973bff3021 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.950884:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787786449.951600:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101bea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+13:2364:x1874629667944064:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 1378us (2111us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786449.951611:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 84 00010000:00010000:2.0:1787786449.951890:0:6700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000089ad9383/0x450132973bff3021 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.951902:0:6700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089ad9383/0x450132973bff3021 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.951913:0:6700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089ad9383/0x450132973bff3021 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.951930:0:6700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089ad9383/0x450132973bff3021 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.952081:0:6700:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787786449.952579:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787786449.952587:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089ad9383/0x450132973bff3021 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.952597:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d4e00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:2.0:1787786449.952602:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089ad9383/0x450132973bff3021 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.952612:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089ad9383/0x450132973bff3021 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.952630:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089ad9383/0x450132973bff3021 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.952639:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089ad9383/0x450132973bff3021 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786449.952660:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786449.952663:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786449.952666:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786449.953267:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101371680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3314:x1874629686799744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9122us (9261us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1787786449.953286:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:3.0:1787786449.954315:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b5101373480/2, rc 0, transno 4294967322 00000100:00100000:3.0:1787786449.954327:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5101373480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686799744:0@lo:6:osp-syn-0-0.0 00000001:00080000:1.0:1787786449.990148:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:1.0:1787786449.990185:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:3.0:1787786449.990453:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101be9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:173d08e0-0e54-474e-858e-1679cd38cf14+7:2364:x1874629667943936:12345-192.168.204.34@tcp:16:lhsmtool_posix.0 Request processed in 40325us (43866us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786449.990465:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 68 00000100:00100000:2.0:1787786449.993520:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786449.994326:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667944320 00000100:00100000:3.0:1787786449.994337:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667944320 00000100:00100000:3.0:1787786449.994403:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 228 00000100:00100000:3.0:1787786449.994414:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b510331f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+20:11640:x1874629667944320:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787786449.994480:0:7644:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786449.994508:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad800/0x450132973bff3005 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752577 expref: 20 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.994527:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8b5210c81700) 00010000:00010000:3.0:1787786449.994532:0:7644:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787786449.994564:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff3028 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.994578:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff3028 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.994587:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff3028 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787786449.995571:0:7644:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fb66a95f reply state 0000000044efadd1 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff3028 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786449.995585:0:7644:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787786449.995778:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b510331f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+21:11640:x1874629667944320:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 Request processed in 1363us (2266us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1787786449.995787:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 228 00000100:00100000:1.0:1787786449.999143:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00010000:00010000:3.0:1787786449.999716:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff3028 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.999732:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff3028 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.999741:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff3028 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.999748:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d5c00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786449.999764:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff3028 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.999772:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff3028 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.999964:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8b5210c81700) 00010000:00010000:3.0:1787786449.999969:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786449.999975:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff3028 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786449.999982:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff3028 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786450.000009:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667944448 00000100:00100000:2.0:1787786450.000020:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667944448 00000100:00100000:2.0:1787786450.000078:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 69 00000100:00100000:2.0:1787786450.000087:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101ab8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+7:2364:x1874629667944448:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787786450.000290:0:8126:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787786450.000294:0:8126:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1787786449 -> 1787786448 00002000:00010000:2.0:1787786450.000296:0:8126:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787786448 00002000:00010000:2.0:1787786450.000299:0:8126:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1787786449 -> 1787786448 00002000:00010000:2.0:1787786450.000301:0:8126:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787786450.000365:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101ab8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+8:2364:x1874629667944448:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 Request processed in 279us (1231us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1787786450.000372:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 69 00000100:00100000:0.0:1787786450.003084:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786450.003414:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667944704 00000100:00100000:2.0:1787786450.003426:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667944704 00000100:00100000:2.0:1787786450.004010:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 229 00000100:00100000:2.0:1787786450.004028:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101beb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+20:11640:x1874629667944704:12345-192.168.204.34@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787786450.004227:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff302f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.004314:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2fe9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752569 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.004325:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff302f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.004357:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752569 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.004372:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2fe9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752569 expref: 20 pid: 5846 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786450.004387:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b510331de00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874629686800128:192.168.204.34@tcp:104: 00000100:00100000:2.0:1787786450.004619:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b520133acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787786450.007384:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b510331de00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874629686800128:192.168.204.34@tcp:104: 00010000:00010000:2.0:1787786450.007413:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff302f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786450.008485:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786450.008736:0:8508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667944832 00000100:00100000:2.0:1787786450.008745:0:8508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667944832 00010000:00010000:2.0:1787786450.008866:0:8508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2fe9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752569 expref: 21 pid: 5846 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786450.008907:0:8508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 85 00000100:00100000:2.0:1787786450.008918:0:8508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101bebc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:173d08e0-0e54-474e-858e-1679cd38cf14+21:2365:x1874629667944832:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787786450.008932:0:8508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787786450.008953:0:8508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2fe9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752569 expref: 21 pid: 5846 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.008966:0:8508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2fe9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752569 expref: 21 pid: 5846 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.008988:0:8508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad200/0x450132973bff2fe9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752569 expref: 21 pid: 5846 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.009013:0:8508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8b5210c81700) 00010000:00010000:2.0:1787786450.009018:0:8508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff302f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.009028:0:8508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff302f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.009036:0:8508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff302f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.009063:0:8508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787786450.009094:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff302f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.009113:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff302f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786450.009119:0:8508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101bebc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:173d08e0-0e54-474e-858e-1679cd38cf14+20:2365:x1874629667944832:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 203us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786450.009126:0:8508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 85 00010000:00010000:3.0:1787786450.009142:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff302f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.009154:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff302f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.009160:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff302f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.009166:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aac600 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786450.009170:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff302f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.009178:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff302f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.009188:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8b5210c81700) 00010000:00010000:3.0:1787786450.009190:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787786450.009194:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff302f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.009199:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac600/0x450132973bff302f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786450.009256:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101beb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+19:11640:x1874629667944704:12345-192.168.204.34@tcp:55:lhsmtool_posix.0 Request processed in 5234us (6182us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787786450.009264:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 229 00000100:00100000:0.0:1787786450.016676:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786450.016740:0:12026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667944960 00000100:00100000:3.0:1787786450.016760:0:12026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667944960 00000100:00100000:3.0:1787786450.016847:0:12026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 70 00000100:00100000:3.0:1787786450.016857:0:12026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101bea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:173d08e0-0e54-474e-858e-1679cd38cf14+8:2364:x1874629667944960:12345-192.168.204.34@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787786450.016901:0:12026:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004fc58dad/0x450132973bff3036 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.016934:0:12026:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000377b8f78/0x450132973bff3013 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752585 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.016943:0:12026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787786450.016948:0:12026:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787786450.016953:0:12026:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fc58dad/0x450132973bff3036 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.016990:0:12026:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000377b8f78/0x450132973bff3013 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752585 expref: 8 pid: 6699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.017005:0:12026:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000377b8f78/0x450132973bff3013 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752585 expref: 8 pid: 6699 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786450.017020:0:12026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5101373840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12026:1874629686800256:192.168.204.34@tcp:104: 00000100:00100000:3.0:1787786450.017783:0:12026:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5102c4b180 going to sleep for 11 seconds 00000100:00100000:2.0:1787786450.020196:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786450.020274:0:12026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5101373840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:12026:1874629686800256:192.168.204.34@tcp:104: 00010000:00010000:3.0:1787786450.020302:0:12026:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004fc58dad/0x450132973bff3036 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786450.020694:0:11675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667945088 00000100:00100000:1.0:1787786450.020702:0:11675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667945088 00010000:00010000:1.0:1787786450.020741:0:11675:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000377b8f78/0x450132973bff3013 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752585 expref: 9 pid: 6699 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786450.021106:0:11675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 86 00000100:00100000:1.0:1787786450.021118:0:11675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b510331de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:173d08e0-0e54-474e-858e-1679cd38cf14+9:2364:x1874629667945088:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787786450.021134:0:11675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786450.021160:0:11675:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000377b8f78/0x450132973bff3013 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752585 expref: 9 pid: 6699 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786450.021174:0:11675:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000377b8f78/0x450132973bff3013 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752585 expref: 9 pid: 6699 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786450.021217:0:11675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000377b8f78/0x450132973bff3013 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752585 expref: 9 pid: 6699 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786450.021233:0:11675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787786450.021298:0:11675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787786450.021305:0:11675:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004fc58dad/0x450132973bff3036 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786450.021315:0:11675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fc58dad/0x450132973bff3036 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786450.021346:0:11675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786450.021442:0:11675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b510331de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:173d08e0-0e54-474e-858e-1679cd38cf14+8:2364:x1874629667945088:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 325us (1255us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786450.021451:0:11675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 86 00010000:00010000:3.0:1787786450.021459:0:12026:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004fc58dad/0x450132973bff3036 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.021469:0:12026:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fc58dad/0x450132973bff3036 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.023536:0:12026:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004fc58dad/0x450132973bff3036 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.023548:0:12026:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fc58dad/0x450132973bff3036 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.023557:0:12026:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fc58dad/0x450132973bff3036 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.023564:0:12026:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d5c00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:3.0:1787786450.023569:0:12026:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fc58dad/0x450132973bff3036 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.023578:0:12026:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fc58dad/0x450132973bff3036 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.023597:0:12026:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fc58dad/0x450132973bff3036 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.023605:0:12026:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fc58dad/0x450132973bff3036 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12026 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786450.023809:0:12026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101bea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:173d08e0-0e54-474e-858e-1679cd38cf14+7:2364:x1874629667944960:12345-192.168.204.34@tcp:1:lhsmtool_posix.0 Request processed in 6936us (7125us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786450.023821:0:12026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 70 00000100:00100000:2.0:1787786450.029976:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786450.032504:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667945344 00000100:00100000:3.0:1787786450.032532:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667945344 00000100:00100000:3.0:1787786450.032655:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 230 00000100:00100000:3.0:1787786450.032666:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b510331f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+19:11640:x1874629667945344:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787786450.032746:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff303d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.032775:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff303d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.032786:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff303d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.033840:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff3044 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.033969:0:8713:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2ff7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752570 expref: 20 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.033997:0:8713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff3044 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.034037:0:8713:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2ff7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752570 expref: 20 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.034054:0:8713:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2ff7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752570 expref: 20 pid: 7644 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786450.034069:0:8713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5206205680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8713:1874629686800384:192.168.204.34@tcp:104: 00000100:00100000:2.0:1787786450.034170:0:8713:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5213472780 going to sleep for 11 seconds 00000100:00100000:1.0:1787786450.042310:0:8713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5206205680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8713:1874629686800384:192.168.204.34@tcp:104: 00010000:00010000:1.0:1787786450.042342:0:8713:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff3044 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786450.043238:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786450.043322:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667945472 00000100:00100000:1.0:1787786450.043330:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667945472 00010000:00010000:1.0:1787786450.043366:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2ff7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752570 expref: 21 pid: 7644 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786450.043414:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 87 00000100:00100000:1.0:1787786450.043424:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5211bf8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+21:2365:x1874629667945472:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787786450.043449:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786450.043456:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2ff7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752570 expref: 21 pid: 7644 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786450.043469:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2ff7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752570 expref: 21 pid: 7644 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786450.043489:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad000/0x450132973bff2ff7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752570 expref: 21 pid: 7644 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786450.043503:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8b5210c81700) 00010000:00010000:1.0:1787786450.043508:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff3044 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786450.043517:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff3044 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786450.043525:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff3044 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786450.043548:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786450.043591:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5211bf8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:173d08e0-0e54-474e-858e-1679cd38cf14+20:2365:x1874629667945472:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 168us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786450.043599:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 87 00010000:00010000:3.0:1787786450.043744:0:8713:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff3044 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.043762:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff3044 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787786450.043980:0:8713:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1787786450.044115:0:8713:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1787786450.044162:0:8713:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1787786450.044245:0:8713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5101373840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8713:1874629686800512:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1787786450.044292:0:8713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786450.044328:0:8713:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5102c4bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787786450.044447:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686800512 00000100:00100000:2.0:1787786450.044452:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686800512 00000100:00100000:2.0:1787786450.044485:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787786450.044492:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101371e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8713:x1874629686800512:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787786450.044566:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101371e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8713:x1874629686800512:12345-0@lo:1000:mdt00_004.0 Request processed in 74us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786450.044573:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787786450.044713:0:8713:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:3.0:1787786450.044719:0:8713:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:3.0:1787786450.044737:0:8713:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b5101373c00, transno 4294967321 00000100:00100000:3.0:1787786450.044768:0:8713:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8b5101373480 x1874629686799744/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787786465 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786450.045438:0:8713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5101373840 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8713:1874629686800512:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1787786450.046330:0:8713:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1787786450.050863:0:8713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5101be9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8713:1874629686800640:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1787786450.050941:0:8713:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786450.050972:0:8713:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52328bdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1787786450.051103:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686800640 00000100:00100000:2.0:1787786450.051115:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686800640 00000100:00100000:2.0:1787786450.051163:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787786450.051173:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8713:x1874629686800640:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1787786450.051417:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101be8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:8713:x1874629686800640:12345-0@lo:1000:mdt00_004.0 Request processed in 245us (475us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1787786450.051426:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787786450.052064:0:8713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5101be9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:8713:1874629686800640:0@lo:1000:mdt00_004.0 00010000:00010000:0.0:1787786450.052108:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff3044 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786450.052118:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff3044 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786450.052126:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff3044 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786450.052131:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aade00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786450.052135:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff3044 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786450.052143:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff3044 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786450.052158:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8b5210c81700) 00010000:00010000:0.0:1787786450.052162:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787786450.052166:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff3044 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786450.052171:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aade00/0x450132973bff3044 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786450.052215:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff2f87 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786450.052222:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff2f87 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786450.052229:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff2f87 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786450.052234:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d9200 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786450.052237:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff2f87 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786450.052242:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff2f87 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786450.052251:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5222ae8600) 00010000:00010000:0.0:1787786450.052253:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787786450.052260:0:8713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2f8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752554 expref: 23 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786450.052271:0:8713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2f8e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752554 expref: 23 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786450.052280:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2f8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752554 expref: 23 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786450.052311:0:8713:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2f8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752554 expref: 23 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786450.052337:0:8713:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5101beb480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8713:1874629686800768:192.168.204.34@tcp:105: 00000100:00100000:0.0:1787786450.052416:0:8713:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52328bdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787786450.054580:0:8713:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5101beb480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:8713:1874629686800768:192.168.204.34@tcp:105: 00010000:00010000:0.0:1787786450.054613:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff2f87 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786450.054623:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff2f87 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786450.054653:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff304b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786450.054666:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff304b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786450.054676:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff304b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786450.054686:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff304b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786450.054692:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff304b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786450.054699:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff304b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786450.054703:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912d400 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786450.054707:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff304b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786450.054728:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff304b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786450.054740:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5222ae8600) 00010000:00010000:0.0:1787786450.054743:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786450.054747:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff304b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786450.054764:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d400/0x450132973bff304b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786450.054774:0:8713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff303d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786450.054781:0:8713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff303d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786450.054787:0:8713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff303d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786450.054834:0:8713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d5c00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786450.054837:0:8713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff303d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786450.054844:0:8713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff303d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786450.054866:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5222ae8600) 00010000:00010000:0.0:1787786450.054869:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787786450.054872:0:8713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff303d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786450.054887:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff303d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786450.055110:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b510331f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+23:11640:x1874629667945344:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 22443us (25142us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1787786450.055120:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 230 00000020:00080000:0.0:1787786450.055126:0:8713:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1787786450.055523:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000040:00080000:1.0:1787786450.056113:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787786450.056119:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787786450.056613:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1787786450.056622:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787786450.057331:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667945600 00000100:00100000:0.0:1787786450.057342:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667945600 00000100:00100000:0.0:1787786450.057398:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 61 00000100:00100000:0.0:1787786450.057408:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101373840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+23:11639:x1874629667945600:12345-192.168.204.34@tcp:49:lfs.0 00000100:00100000:0.0:1787786450.057560:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101373840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+23:11639:x1874629667945600:12345-192.168.204.34@tcp:49:lfs.0 Request processed in 153us (2037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786450.057567:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 61 00000100:00100000:3.0:1787786450.063702:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786450.065070:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667945856 00000100:00100000:2.0:1787786450.065083:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667945856 00000100:00100000:2.0:1787786450.066010:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 231 00000100:00100000:2.0:1787786450.066030:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101370b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+23:11639:x1874629667945856:12345-192.168.204.34@tcp:58:lfs.0 00000040:00080000:2.0:1787786450.066438:0:7644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1787786450.066537:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101370b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+23:11639:x1874629667945856:12345-192.168.204.34@tcp:58:lfs.0 Request processed in 515us (2849us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786450.066546:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 231 00000100:00100000:0.0:1787786450.077152:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786450.077384:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667946112 00000100:00100000:2.0:1787786450.077574:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667946112 00000100:00100000:2.0:1787786450.077643:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 62 00000100:00100000:2.0:1787786450.077654:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52062fe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+23:11640:x1874629667946112:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787786450.083602:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787786450.083695:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1787786450.083764:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff3052 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.083780:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff3052 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.083809:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff3052 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.083818:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff3052 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.083825:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff3052 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.083831:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff3052 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.083861:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787786450.083973:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787786450.083982:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff3052 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.083988:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aacc00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:3.0:1787786450.083992:0:7633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff3052 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.084000:0:7633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff3052 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.084012:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8b5210c81300) 00010000:00010000:3.0:1787786450.084015:0:7633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787786450.084019:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff3052 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.084024:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aacc00/0x450132973bff3052 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.084039:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786450.084041:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786450.084043:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786450.084275:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52062fe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+25:11640:x1874629667946112:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 Request processed in 6618us (7129us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1787786450.084286:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 62 00000020:00080000:2.0:1787786450.084292:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787786450.105649:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786450.105735:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667946240 00000100:00100000:3.0:1787786450.105744:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667946240 00000100:00100000:3.0:1787786450.105835:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 232 00000100:00100000:3.0:1787786450.105846:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+25:11642:x1874629667946240:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:3.0:1787786450.105887:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786450.105907:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff3059 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75258c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.105970:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff3060 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.105985:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff3060 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.105995:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff3060 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.106008:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff3067 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.106015:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff3067 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.106021:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff3067 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.106327:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff306e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.107151:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2f79 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75254d expref: 26 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786450.107167:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff306e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786450.107294:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2f79 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75254d expref: 26 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786450.107318:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2f79 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75254d expref: 26 pid: 7644 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786450.107333:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5101ab9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874629686800896:192.168.204.34@tcp:104: 00000100:00100000:1.0:1787786450.107636:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b4becc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787786450.112414:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5101ab9e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1874629686800896:192.168.204.34@tcp:104: 00010000:00010000:1.0:1787786450.112449:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff306e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786450.117274:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786450.117702:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667946496 00000100:00100000:2.0:1787786450.117713:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667946496 00000100:00100000:2.0:1787786450.117822:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 63 00000100:00100000:2.0:1787786450.117834:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101be83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+27:5617:x1874629667946496:12345-192.168.204.34@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787786450.118071:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101be83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+28:5617:x1874629667946496:12345-192.168.204.34@tcp:35:ldlm_bl.0 Request processed in 239us (807us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1787786450.118079:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 63 00000100:00100000:3.0:1787786450.123673:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786450.124030:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667946624 00000100:00100000:1.0:1787786450.124040:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667946624 00010000:00010000:1.0:1787786450.124086:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2f79 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75254d expref: 28 pid: 7644 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786450.124127:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 88 00000100:00100000:1.0:1787786450.124136:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b51013721c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:173d08e0-0e54-474e-858e-1679cd38cf14+28:2364:x1874629667946624:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787786450.124153:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786450.124159:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2f79 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75254d expref: 28 pid: 7644 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786450.124173:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2f79 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75254d expref: 28 pid: 7644 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786450.124195:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4a00/0x450132973bff2f79 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75254d expref: 28 pid: 7644 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786450.124224:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5222ae8600) 00010000:00010000:1.0:1787786450.124229:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff306e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786450.124238:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff306e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786450.124246:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff306e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786450.124281:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786450.124343:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b51013721c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:173d08e0-0e54-474e-858e-1679cd38cf14+27:2364:x1874629667946624:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 207us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786450.124350:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 88 00010000:00010000:2.0:1787786450.125008:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff306e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.125018:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff306e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786450.125061:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787786450.125065:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787786450.125087:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff306e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.125100:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff306e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.125110:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff3060 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.125129:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff3060 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.125136:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff3060 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.125142:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d4000 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786450.125145:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff3060 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.125152:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff3060 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.125161:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b5204e6f400) 00010000:00010000:2.0:1787786450.125164:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786450.125167:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff3060 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.125172:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4000/0x450132973bff3060 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.125184:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff3067 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.125189:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff3067 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.125194:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff3067 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.125199:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d4c00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786450.125207:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff3067 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.125213:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff3067 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.125220:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8b5204e6fe00) 00010000:00010000:2.0:1787786450.125223:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786450.125225:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff3067 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.125231:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4c00/0x450132973bff3067 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.125280:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff3059 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75258c expref: 27 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.125292:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff306e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75258c expref: 26 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786450.125299:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5222ae8600) 00010000:00010000:2.0:1787786450.125301:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787786450.125303:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d5c00, rc 0) 00000100:00100000:2.0:1787786450.125394:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101beb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+26:11642:x1874629667946240:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 19550us (19755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786450.125402:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 232 00010000:00010000:2.0:1787786450.378735:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787786451.030965:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1787786451.030990:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000040:00080000:3.0:1787786451.085137:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787786451.085150:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787786451.085236:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787786451.085245:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787786451.085423:0:11693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b51013712c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874629686801024:192.168.204.34@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787786451.085607:0:11693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5203e75cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787786451.094126:0:11693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b51013712c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11693:1874629686801024:192.168.204.34@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787786451.109970:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786451.110816:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667946752 00000100:00100000:0.0:1787786451.110845:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667946752 00000100:00100000:0.0:1787786451.121749:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 233 00000100:00100000:0.0:1787786451.121773:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+26:11653:x1874629667946752:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787786451.121865:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787786451.122040:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+26:11653:x1874629667946752:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 Request processed in 275us (12085us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786451.122050:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 233 00000100:00080000:2.0:1787786451.122549:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787786451.128461:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786451.128555:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667947008 00000100:00100000:3.0:1787786451.128567:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667947008 00000100:00100000:3.0:1787786451.128639:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 234 00000100:00100000:3.0:1787786451.128651:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101be8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+26:11653:x1874629667947008:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787786451.128678:0:7644:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786451.128704:0:7644:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff3075 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752593 expref: -99 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786451.129132:0:7644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff307c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786451.129155:0:7644:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff307c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786451.129172:0:7644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff307c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7644 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786451.129186:0:7644:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787786451.129356:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4e00/0x450132973bff3075 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752593 expref: 29 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786451.129376:0:7644:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff307c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752593 expref: 28 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786451.129396:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5222ae8600) 00010000:00010000:3.0:1787786451.129399:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787786451.129404:0:7644:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d5800, rc 0) 00000100:00100000:3.0:1787786451.129482:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101be8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:173d08e0-0e54-474e-858e-1679cd38cf14+28:11653:x1874629667947008:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 832us (1036us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1787786451.129492:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 234 00000100:00100000:3.0:1787786451.139241:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786451.139304:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786451.139358:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667947264 00000100:00100000:3.0:1787786451.139371:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667947264 00000100:00100000:3.0:1787786451.139445:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 235 00000100:00100000:3.0:1787786451.139458:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b51013712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+28:11653:x1874629667947264:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787786451.139577:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff308a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786451.139599:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff308a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786451.139613:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff308a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786451.139918:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff308a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786451.139928:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff308a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786451.139937:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff308a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786451.139954:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d5400 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786451.139960:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff308a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786451.139970:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff308a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786451.139986:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5222ae8600) 00010000:00010000:3.0:1787786451.139990:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787786451.139996:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff308a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786451.140004:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5400/0x450132973bff308a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786451.140189:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b51013712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+29:11653:x1874629667947264:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 732us (962us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1787786451.140200:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 235 00000040:00080000:3.0:1787786451.140363:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787786451.140369:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787786451.140896:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787786451.140908:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787786451.141853:0:11675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667947392 00000100:00100000:1.0:1787786451.141871:0:11675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667947392 00000100:00100000:1.0:1787786451.141965:0:11675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 17 00000100:00100000:1.0:1787786451.141977:0:11675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101373840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:173d08e0-0e54-474e-858e-1679cd38cf14+29:2365:x1874629667947392:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787786451.142000:0:11675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786451.142029:0:11675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5800/0x450132973bff307c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752593 expref: 29 pid: 7644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786451.142053:0:11675:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5222ae8600) 00010000:00010000:1.0:1787786451.142059:0:11675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786451.142115:0:11675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101373840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:173d08e0-0e54-474e-858e-1679cd38cf14+28:2365:x1874629667947392:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 140us (2810us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786451.142141:0:11675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 17 00000040:00080000:0.0:1787786451.144966:0:12576:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787786451.144980:0:12576:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787786451.145050:0:12576:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1787786451.145061:0:12576:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787786451.165022:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786451.165355:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667947648 00000100:00100000:0.0:1787786451.165370:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667947648 00000100:00100000:0.0:1787786451.165489:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 64 00000100:00100000:0.0:1787786451.165501:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206206580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+28:11653:x1874629667947648:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787786451.165894:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206206580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+29:11653:x1874629667947648:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 Request processed in 391us (881us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1787786451.165905:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 64 00000100:00100000:1.0:1787786451.372764:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786451.372898:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667947904 00000100:00100000:0.0:1787786451.372911:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667947904 00000100:00100000:0.0:1787786451.372980:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 236 00000100:00100000:0.0:1787786451.372992:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101aba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+29:11666:x1874629667947904:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:0.0:1787786451.373025:0:8713:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786451.373053:0:8713:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff3091 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75259a expref: -99 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786451.373186:0:8713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff3098 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786451.373206:0:8713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff3098 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786451.373220:0:8713:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff3098 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8713 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787786451.373247:0:8713:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787786451.373411:0:8713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff3091 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75259a expref: 32 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786451.373429:0:8713:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff3098 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75259a expref: 31 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786451.373439:0:8713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5222ae8600) 00010000:00010000:0.0:1787786451.373442:0:8713:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787786451.373445:0:8713:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912c000, rc 0) 00000100:00100000:0.0:1787786451.373630:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101aba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+31:11666:x1874629667947904:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 639us (881us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1787786451.373638:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 236 00000100:00100000:1.0:1787786451.381735:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786451.382168:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667948032 00000100:00100000:2.0:1787786451.382182:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667948032 00000100:00100000:2.0:1787786451.382521:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 237 00000100:00100000:2.0:1787786451.382535:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101ab9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+31:11666:x1874629667948032:12345-192.168.204.34@tcp:54:lfs.0 00010000:00010000:2.0:1787786451.382632:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff30a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786451.382773:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff30a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786451.382891:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff30a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786451.383056:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff30a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786451.383066:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff30a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786451.383074:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff30a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786451.383101:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aac400 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786451.383106:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff30a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786451.383115:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff30a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786451.383131:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5222ae8600) 00010000:00010000:3.0:1787786451.383135:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787786451.383140:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff30a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786451.383148:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac400/0x450132973bff30a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786451.383505:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101ab9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+31:11666:x1874629667948032:12345-192.168.204.34@tcp:54:lfs.0 Request processed in 968us (1790us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786451.383516:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 237 00010000:00010000:2.0:1787786451.402145:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786451.451962:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786451.452075:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667948160 00000100:00100000:3.0:1787786451.452088:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667948160 00000100:00100000:3.0:1787786451.452194:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 71 00000100:00100000:3.0:1787786451.452209:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5206205680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:173d08e0-0e54-474e-858e-1679cd38cf14+7:2365:x1874629667948160:12345-192.168.204.34@tcp:101:cat.0 00010000:00010000:3.0:1787786451.452244:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786451.452275:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090206775/0x450132973bff30ad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7525a1 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787786451.452310:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a8f74d0, atime: 0x6a8f74d0, ctime: 0x6a8f74d0, blocks: 0xb 00010000:00010000:3.0:1787786451.452336:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=377s v=(0 0) 00010000:00010000:3.0:1787786451.452363:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787786451.452378:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090206775/0x450132973bff30ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7525a1 expref: 8 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786451.452415:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000090206775/0x450132973bff30ad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7525a1 expref: 8 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786451.452433:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d5400, rc 0) 00000100:00100000:3.0:1787786451.452522:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5206205680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:173d08e0-0e54-474e-858e-1679cd38cf14+8:2365:x1874629667948160:12345-192.168.204.34@tcp:101:cat.0 Request processed in 317us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786451.452530:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 71 00000100:00080000:2.0:1787786451.452703:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787786451.459618:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786451.460534:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667948288 00000100:00100000:1.0:1787786451.460553:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667948288 00002000:00100000:1.0:1787786451.460629:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8b5101bea1c0 x1874629667948288/t0(0) o3->173d08e0-0e54-474e-858e-1679cd38cf14@192.168.204.34@tcp:67/0 lens 488/0 e 0 to 0 dl 1787786462 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787786451.460642:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8b5101bea1c0 with x1874629667948288 ext(0->4095) 00002000:00010000:1.0:1787786451.460648:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b5101bea1c0 00000100:00100000:1.0:1787786451.460692:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:1.0:1787786451.460703:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101bea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:173d08e0-0e54-474e-858e-1679cd38cf14+8:2364:x1874629667948288:12345-192.168.204.34@tcp:3:cat.0 00000100:00100000:1.0:1787786451.461141:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101bea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:173d08e0-0e54-474e-858e-1679cd38cf14+8:2364:x1874629667948288:12345-192.168.204.34@tcp:3:cat.0 Request processed in 437us (1536us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1787786451.461151:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 7 00002000:00100000:1.0:1787786451.461159:0:6704:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8b5101bea1c0 x1874629667948288/t0(0) o3->173d08e0-0e54-474e-858e-1679cd38cf14@192.168.204.34@tcp:67/0 lens 488/4536 e 0 to 0 dl 1787786462 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787786451.461169:0:6704:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8b5101bea1c0 with x1874629667948288 ext(0->4095) 00002000:00010000:1.0:1787786451.461173:0:6704:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8b5101bea1c0 00000100:00100000:1.0:1787786451.978331:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787786451.978368:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5101bebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686801152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787786451.978496:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786451.978740:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686801152 00000100:00100000:0.0:1787786451.978752:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686801152 00000100:00100000:0.0:1787786451.978870:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787786451.978883:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101ab8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874629686801152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787786451.978940:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787786451.979005:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101ab8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874629686801152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786451.979012:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787786451.979086:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5101bebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686801152:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787786451.979138:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787786452.426408:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786453.002290:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787786453.002510:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686801408:0@lo:400:kworker.0 00000100:00100000:1.0:1787786453.002614:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786453.002689:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787786453.002720:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52328f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686801536:0@lo:400:kworker.0 00000100:00100000:1.0:1787786453.002750:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786453.002843:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686801408 00000100:00100000:1.0:1787786453.002853:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686801408 00000100:00100000:1.0:1787786453.002908:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686801536 00000100:00100000:1.0:1787786453.002911:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686801536 00000100:00100000:1.0:1787786453.002948:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787786453.002958:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101abad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686801408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786453.003025:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101abad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686801408:12345-0@lo:400:kworker.0 Request processed in 68us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786453.003034:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787786453.003059:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1787786453.003065:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101ab83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686801536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786453.003093:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101ab83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686801536:12345-0@lo:400:kworker.0 Request processed in 29us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786453.003098:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:1.0:1787786453.003120:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787786453.003154:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52328f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686801536:0@lo:400:kworker.0 00000100:00100000:1.0:1787786453.003165:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686801408:0@lo:400:kworker.0 00000100:00100000:2.0:1787786453.003453:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52328f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686801664:0@lo:400:kworker.0 00000100:00100000:2.0:1787786453.003498:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786453.003570:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686801280:0@lo:400:kworker.0 00000100:00100000:2.0:1787786453.003601:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786453.003642:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686801280 00000100:00100000:2.0:1787786453.003647:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686801280 00000100:00100000:2.0:1787786453.003679:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1787786453.003687:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3311:x1874629686801280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786453.003736:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f89050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3311:x1874629686801280:12345-0@lo:400:kworker.0 Request processed in 49us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786453.003743:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1787786453.003829:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686801280:0@lo:400:kworker.0 00000100:00100000:3.0:1787786453.004506:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52328f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686801920:0@lo:400:kworker.0 00000100:00100000:3.0:1787786453.004556:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786453.004594:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52328f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874629686801792:0@lo:400:kworker.0 00000100:00100000:1.0:1787786453.004627:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786453.004732:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686801792 00000100:00100000:2.0:1787786453.004738:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686801792 00000100:00100000:2.0:1787786453.004887:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787786453.004897:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101abb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874629686801792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786453.004948:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101abb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874629686801792:12345-0@lo:400:kworker.0 Request processed in 53us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786453.004956:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787786453.004993:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52328f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874629686801792:0@lo:400:kworker.0 00000100:00080000:1.0:1787786453.005157:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787786453.005337:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686801664 00000100:00100000:0.0:1787786453.005344:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686801664 00000100:00100000:0.0:1787786453.005407:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686801920 00000100:00100000:0.0:1787786453.005412:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686801920 00000100:00100000:0.0:1787786453.005438:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787786453.005448:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bfdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1874629686801664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786453.005501:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bfdcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1874629686801664:12345-0@lo:400:kworker.0 Request processed in 57us (2002us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786453.005507:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787786453.005522:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1787786453.005528:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686801920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786453.005554:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686801920:12345-0@lo:400:kworker.0 Request processed in 27us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786453.005559:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787786453.005634:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1787786453.005642:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1787786453.005667:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b510331e1c0, transno 4294967310 00000100:00100000:3.0:1787786453.005687:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52328f1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686801920:0@lo:400:kworker.0 00000100:00100000:3.0:1787786453.005739:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52328f0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686801664:0@lo:400:kworker.0 00000100:00080000:2.0:1787786453.009908:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787786453.009922:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787786453.451331:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786453.514837:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bfdde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686802048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787786453.514967:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786453.515354:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686802048 00000100:00100000:2.0:1787786453.515366:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686802048 00000100:00100000:2.0:1787786453.515430:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787786453.515443:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101bead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686802048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787786453.515491:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787786453.515566:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101bead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686802048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786453.515574:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787786453.515694:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bfdde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686802048:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787786454.474744:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786454.967706:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786454.967908:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786454.967951:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786454.967970:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786454.967995:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786454.968059:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667948416 00000100:00100000:0.0:1787786454.968071:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667948416 00000100:00100000:0.0:1787786454.968131:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 293 00000100:00100000:0.0:1787786454.968152:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2362:x1874629667948416:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1787786454.968242:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2362:x1874629667948416:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 101us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786454.968250:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 293 00000100:00100000:0.0:1787786454.968287:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667948800 00000100:00100000:0.0:1787786454.968291:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667948800 00000100:00100000:0.0:1787786454.968326:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667948672 00000100:00100000:0.0:1787786454.968330:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667948672 00000100:00100000:0.0:1787786454.968370:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 91 00000100:00100000:0.0:1787786454.968378:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+5:2362:x1874629667948800:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1787786454.968408:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+5:2362:x1874629667948800:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 31us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786454.968414:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 91 00000100:00100000:0.0:1787786454.968426:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 92 00000100:00100000:0.0:1787786454.968433:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+8:2362:x1874629667948672:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1787786454.968460:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+8:2362:x1874629667948672:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 28us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786454.968466:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 92 00000100:00080000:2.0:1787786454.969960:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787786454.969969:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787786454.976137:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667948544 00000100:00100000:1.0:1787786454.976218:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667948544 00000100:00100000:1.0:1787786454.976311:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667948928 00000100:00100000:1.0:1787786454.976315:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667948928 00000100:00100000:1.0:1787786454.976349:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 150 00000100:00100000:1.0:1787786454.976374:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52328f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+31:2362:x1874629667948544:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1787786454.976467:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52328f0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:173d08e0-0e54-474e-858e-1679cd38cf14+31:2362:x1874629667948544:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 95us (8780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786454.976476:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 150 00000100:00100000:1.0:1787786454.976495:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 151 00000100:00100000:1.0:1787786454.976502:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e407027-7940-45d9-87d7-56031cd08b7a+5:2362:x1874629667948928:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1787786454.976526:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6e407027-7940-45d9-87d7-56031cd08b7a+5:2362:x1874629667948928:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 24us (8530us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786454.976532:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 151 00000100:00080000:3.0:1787786454.980683:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1787786455.097313:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:0.0:1787786455.097328:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:3.0:1787786455.125175:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:3.0:1787786455.125220:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1787786455.125247:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8b5102c4bc00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1787786455.125253:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8b5232f0f500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8b5102c4b9c0 00000020:00080000:3.0:1787786455.125257:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8b5232f0f400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8b523288d800 00000020:00080000:0.0:1787786455.125351:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1787786455.125529:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1787786455.498612:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786456.116237:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786456.116473:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667949056 00000100:00100000:2.0:1787786456.116484:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667949056 00000100:00100000:2.0:1787786456.116568:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 238 00000100:00080000:3.0:1787786456.116574:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787786456.116580:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101be9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+18:11319:x1874629667949056:12345-192.168.204.34@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787786456.116727:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101be9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:173d08e0-0e54-474e-858e-1679cd38cf14+18:11319:x1874629667949056:12345-192.168.204.34@tcp:60:lhsmtool_posix.0 Request processed in 144us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786456.116736:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 238 00000100:00100000:1.0:1787786456.120969:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786456.121054:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667949312 00000100:00100000:3.0:1787786456.121064:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667949312 00000100:00100000:3.0:1787786456.121178:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 65 00000100:00100000:3.0:1787786456.121188:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101ab9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+18:11319:x1874629667949312:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787786456.121747:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101ab9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+19:11319:x1874629667949312:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 Request processed in 559us (786us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1787786456.121757:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 65 00000040:00080000:3.0:1787786456.266089:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787786456.266099:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787786456.267785:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1787786456.267815:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787786456.331305:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786456.331492:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667949440 00000100:00100000:1.0:1787786456.331504:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667949440 00000100:00100000:1.0:1787786456.331591:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 239 00000100:00080000:3.0:1787786456.331594:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787786456.331604:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e407027-7940-45d9-87d7-56031cd08b7a+5:12117:x1874629667949440:12345-192.168.204.34@tcp:101:lsof.0 00010000:00010000:1.0:1787786456.331626:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786456.331657:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff30b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7525a8 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786456.331717:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff30bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786456.331732:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff30bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786456.331845:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff30bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787786456.332048:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787786456.332052:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787786456.332127:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff30bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786456.332153:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff30b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7525a8 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786456.332317:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff30bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7525a8 expref: 6 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786456.332326:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5222ae8100) 00010000:00010000:1.0:1787786456.332329:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787786456.332333:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523b4d9400, rc 0) 00000100:00100000:1.0:1787786456.332410:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e407027-7940-45d9-87d7-56031cd08b7a+6:12117:x1874629667949440:12345-192.168.204.34@tcp:101:lsof.0 Request processed in 809us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786456.332418:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 239 00010000:00010000:2.0:1787786456.525327:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786457.098040:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5101bebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686802176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787786457.098131:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786457.098298:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686802176 00000100:00100000:1.0:1787786457.098307:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686802176 00000100:00100000:1.0:1787786457.098370:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787786457.098381:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52332c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686802176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787786457.098428:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787786457.098489:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52332c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686802176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786457.098497:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787786457.098572:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1787786457.098580:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b5101373480, transno 4294967322 00000004:00080000:0.0:1787786457.098606:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00080000:3.0:1787786457.098639:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787786457.098647:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5101bebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686802176:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787786457.546049:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786458.122305:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b510331e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874629686802560:0@lo:400:kworker.0 00000100:00100000:1.0:1787786458.122399:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786458.122408:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b510331da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686802688:0@lo:400:kworker.0 00000100:00100000:0.0:1787786458.122446:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786458.122523:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686802432:0@lo:400:kworker.0 00000100:00100000:3.0:1787786458.122556:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786458.122578:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b510331de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686802944:0@lo:400:kworker.0 00000100:00100000:3.0:1787786458.122611:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786458.122652:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686802560 00000100:00100000:3.0:1787786458.122668:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686802560 00000100:00100000:3.0:1787786458.122744:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686802432 00000100:00100000:3.0:1787786458.122748:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686802432 00000100:00100000:3.0:1787786458.122773:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787786458.122784:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b522349e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874629686802560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786458.122853:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b522349e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874629686802560:12345-0@lo:400:kworker.0 Request processed in 71us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786458.122861:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787786458.122875:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787786458.122882:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52332c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686802432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786458.122912:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52332c1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686802432:12345-0@lo:400:kworker.0 Request processed in 31us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786458.122918:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:3.0:1787786458.122938:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787786458.122967:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686802432:0@lo:400:kworker.0 00000100:00100000:3.0:1787786458.123019:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686802688 00000100:00100000:3.0:1787786458.123023:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686802688 00000100:00100000:3.0:1787786458.123046:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686802944 00000100:00100000:3.0:1787786458.123049:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686802944 00000100:00100000:3.0:1787786458.123074:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787786458.123080:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101bebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686802688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786458.123110:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101bebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686802688:12345-0@lo:400:kworker.0 Request processed in 31us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786458.123116:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787786458.123128:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787786458.123134:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52332c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686802944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786458.123164:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52332c30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686802944:12345-0@lo:400:kworker.0 Request processed in 31us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786458.123177:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1787786458.123196:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787786458.123213:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b510331de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686802944:0@lo:400:kworker.0 00000100:00100000:1.0:1787786458.123474:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b510331e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874629686802560:0@lo:400:kworker.0 00000100:00100000:2.0:1787786458.123937:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686802304:0@lo:400:kworker.0 00000100:00100000:2.0:1787786458.123981:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786458.124023:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b510331e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874629686802816:0@lo:400:kworker.0 00000100:00100000:2.0:1787786458.124046:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786458.124127:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686802816 00000100:00100000:1.0:1787786458.124133:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686802816 00000100:00100000:1.0:1787786458.124178:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787786458.124185:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bfdde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874629686802816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786458.124222:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bfdde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874629686802816:12345-0@lo:400:kworker.0 Request processed in 38us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786458.124229:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:2.0:1787786458.124291:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787786458.124313:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b510331e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874629686802816:0@lo:400:kworker.0 00000100:00100000:3.0:1787786458.124384:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686802304 00000100:00100000:3.0:1787786458.124389:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686802304 00000100:00100000:3.0:1787786458.124422:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1787786458.124430:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3312:x1874629686802304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786458.124603:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f88c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3312:x1874629686802304:12345-0@lo:400:kworker.0 Request processed in 163us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786458.124610:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1787786458.124704:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686802304:0@lo:400:kworker.0 00000100:00100000:0.0:1787786458.126948:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b510331da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686802688:0@lo:400:kworker.0 00010000:00010000:1.0:1787786458.570041:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786458.634804:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787786458.634828:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5101373480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686803072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787786458.634894:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786458.635063:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686803072 00000100:00100000:2.0:1787786458.635080:0:6702:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686803072 00000100:00100000:2.0:1787786458.635122:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787786458.635131:0:6702:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52332c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686803072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787786458.635282:0:6702:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787786458.635333:0:6702:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52332c1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686803072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 203us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786458.635341:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787786458.635429:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5101373480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686803072:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1787786459.523636:0:12779:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 19:20:58 (1787786458) 00010000:00010000:2.0:1787786459.594812:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786460.083692:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786460.083737:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786460.083771:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786460.083818:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786460.083851:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786460.083884:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667949568 00000100:00100000:1.0:1787786460.083895:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667949568 00000100:00100000:0.0:1787786460.083994:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667949696 00000100:00100000:0.0:1787786460.084008:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667949696 00000100:00100000:0.0:1787786460.084080:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667950080 00000100:00100000:0.0:1787786460.084097:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667950080 00000100:00100000:0.0:1787786460.084141:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 155 00000100:00100000:0.0:1787786460.084157:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237b53840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+19:2363:x1874629667949696:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786460.084260:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667949952 00000100:00100000:0.0:1787786460.084261:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237b53840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:173d08e0-0e54-474e-858e-1679cd38cf14+19:2363:x1874629667949696:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 109us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786460.084269:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667949952 00000100:00100000:0.0:1787786460.084275:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 155 00000100:00100000:0.0:1787786460.084299:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 156 00000100:00100000:0.0:1787786460.084312:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a57c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e407027-7940-45d9-87d7-56031cd08b7a+6:2363:x1874629667950080:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1787786460.084335:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 295 00000100:00100000:1.0:1787786460.084355:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2363:x1874629667949568:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1787786460.084357:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a57c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e407027-7940-45d9-87d7-56031cd08b7a+6:2363:x1874629667950080:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 41us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786460.084375:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 156 00000100:00100000:1.0:1787786460.084422:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2363:x1874629667949568:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 76us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786460.084432:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 295 00000100:00100000:3.0:1787786460.084509:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667949824 00000100:00100000:3.0:1787786460.084513:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667949824 00000100:00100000:2.0:1787786460.084689:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 95 00000100:00100000:2.0:1787786460.084698:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237b521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+5:2363:x1874629667949952:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786460.084729:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237b521c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+5:2363:x1874629667949952:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 33us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786460.084736:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 95 00000100:00100000:3.0:1787786460.084820:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 96 00000100:00100000:3.0:1787786460.084889:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a56580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+7:2363:x1874629667949824:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1787786460.084919:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a56580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+7:2363:x1874629667949824:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 92us (1101us total) trans 0 rc 0/0 00000100:00080000:2.0:1787786460.085004:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787786460.085009:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787786460.085012:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787786460.085287:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 96 00000020:00080000:3.0:1787786460.204169:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:3.0:1787786460.204207:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1787786460.204347:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1787786460.204363:0:5880:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1787786460.639305:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786461.643146:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786462.220706:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52332c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686803200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787786462.220871:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786462.221005:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686803200 00000100:00100000:1.0:1787786462.221024:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686803200 00000100:00080000:3.0:1787786462.221093:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787786462.221112:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787786462.221126:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523be2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686803200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787786462.221196:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787786462.221272:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523be2dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686803200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786462.221280:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787786462.221787:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52332c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686803200:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787786462.666043:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786463.242101:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787786463.244178:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52332c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874629686803584:0@lo:400:kworker.0 00000100:00100000:2.0:1787786463.244261:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786463.244331:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787786463.244338:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52332c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686803456:0@lo:400:kworker.0 00000100:00100000:2.0:1787786463.244363:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786463.244405:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686803584 00000100:00100000:2.0:1787786463.244412:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686803584 00000100:00100000:2.0:1787786463.244466:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686803456 00000100:00100000:2.0:1787786463.244469:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686803456 00000100:00100000:2.0:1787786463.244493:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787786463.244516:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101373c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874629686803584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786463.244571:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101373c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874629686803584:12345-0@lo:400:kworker.0 Request processed in 57us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786463.244579:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787786463.244598:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787786463.244605:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686803456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786463.244651:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101373480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686803456:12345-0@lo:400:kworker.0 Request processed in 46us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786463.244658:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:2.0:1787786463.244677:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787786463.244715:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52332c03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686803456:0@lo:400:kworker.0 00000100:00100000:2.0:1787786463.244743:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52332c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874629686803584:0@lo:400:kworker.0 00000100:00100000:0.0:1787786463.246989:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b522349f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686803712:0@lo:400:kworker.0 00000100:00100000:0.0:1787786463.247050:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786463.247102:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52332c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686803328:0@lo:400:kworker.0 00000100:00100000:0.0:1787786463.247126:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786463.247467:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686803712 00000100:00100000:2.0:1787786463.247475:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686803712 00000100:00100000:2.0:1787786463.247533:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787786463.247542:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101be9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686803712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786463.247592:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101be9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686803712:12345-0@lo:400:kworker.0 Request processed in 51us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786463.247599:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1787786463.248421:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787786463.248444:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b510331da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686803968:0@lo:400:kworker.0 00000100:00100000:3.0:1787786463.248480:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786463.248523:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686803968 00000100:00100000:3.0:1787786463.248528:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686803968 00000100:00100000:3.0:1787786463.248564:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1787786463.248571:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b510331e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686803968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786463.248606:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b510331e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686803968:12345-0@lo:400:kworker.0 Request processed in 36us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786463.248612:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1787786463.248627:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787786463.248651:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b510331da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686803968:0@lo:400:kworker.0 00000100:00100000:0.0:1787786463.248771:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b522349f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686803712:0@lo:400:kworker.0 00000100:00100000:0.0:1787786463.248782:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787786463.248801:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b510331d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874629686803840:0@lo:400:kworker.0 00000100:00100000:0.0:1787786463.248838:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786463.248967:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686803840 00000100:00100000:3.0:1787786463.248971:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686803840 00000100:00100000:3.0:1787786463.249008:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1787786463.249014:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101bead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874629686803840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786463.249046:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101bead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874629686803840:12345-0@lo:400:kworker.0 Request processed in 32us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786463.249052:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:0.0:1787786463.249150:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787786463.249176:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b510331d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874629686803840:0@lo:400:kworker.0 00000100:00100000:1.0:1787786463.249333:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686803328 00000100:00100000:1.0:1787786463.249338:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686803328 00000100:00100000:1.0:1787786463.249370:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1787786463.249377:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3311:x1874629686803328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786463.249456:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3311:x1874629686803328:12345-0@lo:400:kworker.0 Request processed in 79us (2327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786463.249462:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1787786463.250596:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52332c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686803328:0@lo:400:kworker.0 00000100:00100000:1.0:1787786463.600925:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786463.601082:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667950336 00000100:00100000:3.0:1787786463.601092:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667950336 00000100:00100000:3.0:1787786463.601174:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 66 00000100:00100000:3.0:1787786463.601185:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+18:12338:x1874629667950336:12345-192.168.204.34@tcp:35:umount.0 00000100:00100000:3.0:1787786463.601861:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a552c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+19:12338:x1874629667950336:12345-192.168.204.34@tcp:35:umount.0 Request processed in 674us (942us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1787786463.601872:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 66 00000100:00080000:0.0:1787786463.601966:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787786463.609264:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786463.609525:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667950592 00000100:00100000:0.0:1787786463.609538:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667950592 00000100:00100000:0.0:1787786463.609626:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 67 00000100:00100000:0.0:1787786463.609639:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b510331da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+19:12338:x1874629667950592:12345-192.168.204.34@tcp:35:umount.0 00000100:00100000:0.0:1787786463.610394:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b510331da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+20:12338:x1874629667950592:12345-192.168.204.34@tcp:35:umount.0 Request processed in 751us (1139us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1787786463.610406:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 67 00000100:00100000:1.0:1787786463.617994:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786463.618171:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667950848 00000100:00100000:2.0:1787786463.618187:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667950848 00000100:00100000:2.0:1787786463.618276:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 68 00000100:00100000:2.0:1787786463.618294:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52062fcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+20:12338:x1874629667950848:12345-192.168.204.34@tcp:35:umount.0 00000100:00100000:2.0:1787786463.619634:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52062fcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:173d08e0-0e54-474e-858e-1679cd38cf14+21:12338:x1874629667950848:12345-192.168.204.34@tcp:35:umount.0 Request processed in 1264us (1579us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1787786463.619976:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 68 00000100:00100000:1.0:1787786463.626529:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786463.627124:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667951104 00000100:00100000:0.0:1787786463.627142:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667951104 00000100:00100000:0.0:1787786463.627283:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 69 00000100:00100000:0.0:1787786463.627298:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a55e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+21:12338:x1874629667951104:12345-192.168.204.34@tcp:35:umount.0 00000100:00100000:0.0:1787786463.627913:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a55e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:173d08e0-0e54-474e-858e-1679cd38cf14+22:12338:x1874629667951104:12345-192.168.204.34@tcp:35:umount.0 Request processed in 616us (1395us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1787786463.627923:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 69 00000100:00100000:3.0:1787786463.631482:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786463.631544:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786463.631818:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667951232 00000100:00100000:1.0:1787786463.631832:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667951232 00000100:00100000:1.0:1787786463.631919:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667951488 00000100:00100000:1.0:1787786463.631923:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667951488 00000100:00100000:1.0:1787786463.631955:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 18 00000100:00100000:1.0:1787786463.631968:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b510331e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+14:2365:x1874629667951232:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787786463.632002:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786463.632030:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b520151a200/0x450132973bff2133 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752133 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786463.632055:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787786463.632086:0:11675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 19 00000100:00100000:2.0:1787786463.632100:0:11675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b510331de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2365:x1874629667951488:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787786463.632111:0:11675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787786463.632131:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b510331e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+13:2365:x1874629667951232:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 163us (663us total) trans 0 rc 0/0 00010000:00010000:2.0:1787786463.632144:0:11675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b520912cc00/0x450132973bff231d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521fe expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786463.632161:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 18 00010000:00010000:2.0:1787786463.632164:0:11675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787786463.632193:0:11675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b510331de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:23c8a9a2-8e74-48e9-afab-5150ec6daf69+11:2365:x1874629667951488:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 97us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786463.632201:0:11675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 19 00000100:00100000:3.0:1787786463.633088:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786463.633216:0:8508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667951360 00000100:00100000:2.0:1787786463.633224:0:8508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667951360 00000100:00100000:2.0:1787786463.633308:0:8508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 20 00000100:00100000:2.0:1787786463.633318:0:8508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b510331da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23c8a9a2-8e74-48e9-afab-5150ec6daf69+11:2365:x1874629667951360:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787786463.633330:0:8508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787786463.633345:0:8508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b52421d4600/0x450132973bff2099 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7520fb expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786463.633371:0:8508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787786463.633418:0:8508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b510331da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:2365:x1874629667951360:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 101us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786463.633426:0:8508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 20 00000100:00100000:1.0:1787786463.637317:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786463.637467:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667951616 00000100:00100000:3.0:1787786463.637480:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667951616 00000100:00100000:3.0:1787786463.637571:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 72 00000100:00100000:3.0:1787786463.637602:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237a552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+5:2361:x1874629667951616:12345-192.168.204.34@tcp:9:umount.0 00000020:00000080:3.0:1787786463.637650:0:6699:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff240b 00000100:00080000:3.0:1787786463.637662:0:6699:0:(import.c:65:import_set_state_nolock()) ffff8b523c0b5800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787786463.637738:0:6699:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00080000:0.0:1787786463.638188:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787786463.638775:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786463.638876:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237a552c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:173d08e0-0e54-474e-858e-1679cd38cf14+2:2361:x1874629667951616:12345-192.168.204.34@tcp:9:umount.0 Request processed in 1271us (1567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786463.638889:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 72 00000100:00100000:0.0:1787786463.648160:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786463.648477:0:8126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667952000 00000100:00100000:3.0:1787786463.648501:0:8126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667952000 00000100:00100000:3.0:1787786463.648765:0:8126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 73 00000100:00100000:3.0:1787786463.648778:0:8126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101be83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+7:2361:x1874629667952000:12345-192.168.204.34@tcp:9:umount.0 00000020:00000080:3.0:1787786463.648872:0:8126:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff266c 00000020:00010000:3.0:1787786463.648883:0:8126:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8b52112fc800: total 0 00000100:00080000:3.0:1787786463.648889:0:8126:0:(import.c:65:import_set_state_nolock()) ffff8b52112f9800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787786463.648942:0:8126:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1787786463.649309:0:8126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101be83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:173d08e0-0e54-474e-858e-1679cd38cf14+5:2361:x1874629667952000:12345-192.168.204.34@tcp:9:umount.0 Request processed in 532us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786463.649319:0:8126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 73 00000020:00010000:2.0:1787786463.650891:0:7633:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8b52112fc800: total 0 00010000:00010000:2.0:1787786463.650972:0:7633:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8b52112fc800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1787786463.651062:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090206775/0x450132973bff30ad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7525a1 expref: 4 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786463.651108:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008358bafe/0x450132973bff2a0f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523d3 expref: 3 pid: 12026 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786463.651151:0:7633:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8b52112fc800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1787786463.651164:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786463.651166:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786463.651168:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787786463.651475:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787786463.660929:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786463.661095:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667953024 00000100:00100000:2.0:1787786463.661109:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667953024 00000100:00100000:2.0:1787786463.661195:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 240 00000100:00100000:2.0:1787786463.661208:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b522349f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+22:2361:x1874629667953024:12345-192.168.204.34@tcp:39:umount.0 00000020:00000080:2.0:1787786463.661256:0:5847:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff20a7 00000020:00010000:2.0:1787786463.661280:0:5847:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8b5237c5e000: total 0 00000100:00080000:2.0:1787786463.661287:0:5847:0:(import.c:65:import_set_state_nolock()) ffff8b5237c5a800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787786463.661332:0:5847:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:2.0:1787786463.661867:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b522349f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:173d08e0-0e54-474e-858e-1679cd38cf14+21:2361:x1874629667953024:12345-192.168.204.34@tcp:39:umount.0 Request processed in 659us (951us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1787786463.661877:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 240 00000020:00010000:1.0:1787786463.662148:0:5834:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8b5237c5e000: total 0 00010000:00010000:1.0:1787786463.662209:0:5834:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8b5237c5e000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787786463.662257:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b5204e6f400) 00010000:00010000:1.0:1787786463.662261:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787786463.662273:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff2d6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7524c8 expref: 20 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786463.662296:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b52100f1600) 00010000:00010000:1.0:1787786463.662299:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787786463.662303:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aad400/0x450132973bff26ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7522fa expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786463.662320:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8b5204e6f500) 00010000:00010000:1.0:1787786463.662323:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787786463.662327:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7000/0x450132973bff2371 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75220c expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786463.662345:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8b5204e6f400) 00010000:00010000:1.0:1787786463.662348:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787786463.662362:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d4400/0x450132973bff2a8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523f6 expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786463.662383:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5210c81400) 00010000:00010000:1.0:1787786463.662386:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787786463.662390:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff28f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752386 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786463.662431:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8b52100f1600) 00010000:00010000:1.0:1787786463.662434:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787786463.662439:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5201676000/0x450132973bff23e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752228 expref: 15 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786463.662458:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5222ae8600) 00010000:00010000:1.0:1787786463.662461:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787786463.662465:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5600/0x450132973bff2f8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752554 expref: 14 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786463.662480:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5222ae8100) 00010000:00010000:1.0:1787786463.662482:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787786463.662495:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff2a71 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523ef expref: 13 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786463.662510:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b5210c81800) 00010000:00010000:1.0:1787786463.662512:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787786463.662517:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b5237aac800/0x450132973bff238d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752213 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786463.662533:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5222ae8600) 00010000:00010000:1.0:1787786463.662536:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787786463.662539:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b52421d5c00/0x450132973bff306e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75258c expref: 11 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786463.662551:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8b5222ae8600) 00010000:00010000:1.0:1787786463.662554:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787786463.662566:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff3098 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75259a expref: 10 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786463.662585:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5210c81400) 00010000:00010000:1.0:1787786463.662587:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787786463.662590:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff29d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523be expref: 9 pid: 8713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786463.662603:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8b5210c81400) 00010000:00010000:1.0:1787786463.662605:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787786463.662609:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9000/0x450132973bff29fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7523cc expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786463.662622:0:5834:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8b5237c5e000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1787786463.662637:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786463.662639:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786463.662641:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786463.690525:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786463.756728:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52332c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686804096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787786463.756876:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786463.757222:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686804096 00000100:00100000:0.0:1787786463.757234:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686804096 00000100:00100000:0.0:1787786463.757304:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1787786463.757316:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b510331d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686804096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787786463.757369:0:6701:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787786463.757439:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b510331d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686804096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786463.757464:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787786463.757868:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52332c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686804096:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787786464.714350:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786465.202073:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786465.202139:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786465.202261:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667953280 00000100:00100000:0.0:1787786465.202274:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667953280 00000100:00100000:0.0:1787786465.202371:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 160 00000100:00100000:0.0:1787786465.202385:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5205315e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e407027-7940-45d9-87d7-56031cd08b7a+6:2363:x1874629667953280:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1787786465.202513:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5205315e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e407027-7940-45d9-87d7-56031cd08b7a+6:2363:x1874629667953280:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 132us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786465.202523:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 160 00000100:00080000:1.0:1787786465.202762:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787786465.203179:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667953152 00000100:00100000:2.0:1787786465.203189:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667953152 00000100:00100000:2.0:1787786465.203283:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 297 00000100:00100000:2.0:1787786465.203294:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:2363:x1874629667953152:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786465.203355:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:2363:x1874629667953152:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 63us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786465.203364:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 297 00000001:00080000:3.0:1787786465.344638:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:3.0:1787786465.344692:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 173d08e0-0e54-474e-858e-1679cd38cf14 00000001:00080000:3.0:1787786465.344701:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1787786465.344711:0:5868:0:(genops.c:885:class_export_put()) final put ffff8b5237c5e000/173d08e0-0e54-474e-858e-1679cd38cf14 00000020:00000080:2.0:1787786465.344783:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5237c5e000/173d08e0-0e54-474e-858e-1679cd38cf14 for lustre-MDT0000 00000020:00000080:2.0:1787786465.344921:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5237c5a800 for lustre-MDT0000 00000001:00100000:0.0:1787786465.346846:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 173d08e0-0e54-474e-858e-1679cd38cf14 00000020:00000080:0.0:1787786465.346857:0:6723:0:(genops.c:885:class_export_put()) final put ffff8b52112fc800/173d08e0-0e54-474e-858e-1679cd38cf14 00000020:00000080:3.0:1787786465.346919:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b52112fc800/173d08e0-0e54-474e-858e-1679cd38cf14 for lustre-OST0000 00000020:00000080:3.0:1787786465.346985:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b52112f9800 for lustre-OST0000 00000100:00100000:1.0:1787786465.411155:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786465.411205:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786465.411253:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786465.411490:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667953536 00000100:00100000:1.0:1787786465.411500:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667953536 00000100:00100000:1.0:1787786465.411563:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667953408 00000100:00100000:1.0:1787786465.411567:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667953408 00000100:00100000:1.0:1787786465.411587:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667953664 00000100:00100000:1.0:1787786465.411590:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667953664 00000100:00100000:1.0:1787786465.411606:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 21 00000100:00100000:1.0:1787786465.411625:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c08780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+12:2362:x1874629667953536:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787786465.411644:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786465.411666:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b523bcb7400/0x450132973bff2180 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752172 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786465.411683:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786465.411738:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c08780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+11:2362:x1874629667953536:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 114us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786465.411745:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 21 00000100:00100000:1.0:1787786465.411764:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 22 00000100:00100000:1.0:1787786465.411770:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5211bf8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+10:2362:x1874629667953408:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787786465.411778:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786465.411786:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b520912c800/0x450132973bff2179 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752148 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786465.411839:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786465.411858:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5211bf8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+9:2362:x1874629667953408:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 88us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786465.411864:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 22 00000100:00100000:1.0:1787786465.411902:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 23 00000100:00100000:1.0:1787786465.411909:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c0a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+8:2362:x1874629667953664:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787786465.411916:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786465.411924:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b520912ca00/0x450132973bff2316 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7521f7 expref: 8 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786465.411932:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786465.411954:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c0a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+7:2362:x1874629667953664:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 46us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786465.411961:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 23 00000100:00100000:0.0:1787786465.432284:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786465.432398:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667953920 00000100:00100000:2.0:1787786465.432408:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667953920 00000100:00100000:2.0:1787786465.432479:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 241 00000100:00100000:2.0:1787786465.432490:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b51032912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e407027-7940-45d9-87d7-56031cd08b7a+6:2361:x1874629667953920:12345-192.168.204.34@tcp:39:umount.0 00000020:00000080:2.0:1787786465.432531:0:5848:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff218e 00000020:00010000:2.0:1787786465.432542:0:5848:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8b5237c44800: total 0 00000100:00080000:2.0:1787786465.432547:0:5848:0:(import.c:65:import_set_state_nolock()) ffff8b5237c45000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787786465.432574:0:5848:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:1.0:1787786465.432616:0:5834:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8b5237c44800: total 0 00010000:00010000:1.0:1787786465.432627:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786465.432737:0:5834:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8b5237c44800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787786465.432855:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5222ae8100) 00010000:00010000:1.0:1787786465.432860:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787786465.432876:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9400/0x450132973bff30bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7525a8 expref: 5 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786465.432909:0:5834:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8b5237c44800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787786465.432927:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786465.432930:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786465.432938:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786465.433141:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b51032912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e407027-7940-45d9-87d7-56031cd08b7a+3:2361:x1874629667953920:12345-192.168.204.34@tcp:39:umount.0 Request processed in 649us (865us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1787786465.433151:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 241 00000100:00100000:1.0:1787786465.458755:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786465.459076:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667954176 00000100:00100000:0.0:1787786465.459092:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667954176 00000100:00100000:0.0:1787786465.459158:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 298 00000100:00100000:0.0:1787786465.459169:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+7:2361:x1874629667954176:12345-192.168.204.34@tcp:251:umount.0 00000020:00000080:0.0:1787786465.459216:0:5840:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff2084 00000020:00010000:0.0:1787786465.459224:0:5840:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8b5237bb9000: total 0 00000100:00080000:0.0:1787786465.459229:0:5840:0:(import.c:65:import_set_state_nolock()) ffff8b5237bb8800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787786465.459317:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:23c8a9a2-8e74-48e9-afab-5150ec6daf69+3:2361:x1874629667954176:12345-192.168.204.34@tcp:251:umount.0 Request processed in 151us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786465.459326:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 298 00000020:00010000:2.0:1787786465.459476:0:5835:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8b5237bb9000: total 0 00010000:00010000:2.0:1787786465.459543:0:5835:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8b5237bb9000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787786465.459586:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b520151b400/0x450132973bff213a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75213a expref: 2 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786465.459605:0:5835:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8b5237bb9000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1787786465.459614:0:5835:0:(genops.c:885:class_export_put()) final put ffff8b5237bb9000/23c8a9a2-8e74-48e9-afab-5150ec6daf69 00010000:00010000:2.0:1787786465.459649:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786465.459652:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786465.459653:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787786465.459860:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5237bb9000/23c8a9a2-8e74-48e9-afab-5150ec6daf69 for MGS 00000020:00000080:0.0:1787786465.459907:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5237bb8800 for MGS 00010000:00010000:2.0:1787786465.741084:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787786466.372125:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 173d08e0-0e54-474e-858e-1679cd38cf14 00000020:00000080:1.0:1787786466.372133:0:7647:0:(genops.c:885:class_export_put()) final put ffff8b523c0b0800/173d08e0-0e54-474e-858e-1679cd38cf14 00000020:00000080:1.0:1787786466.372460:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8b523c0b0800/173d08e0-0e54-474e-858e-1679cd38cf14 for lustre-OST0001 00000020:00000080:1.0:1787786466.372503:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b523c0b5800 for lustre-OST0001 00000040:00080000:1.0:1787786466.508130:0:11693:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787786466.508141:0:11693:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787786466.509325:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1787786466.510057:0:11693:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1787786466.764399:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787786467.057635:0:12981:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787786467.081104:0:12981:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1787786467.081158:0:12981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6400/0x450132973bff2109 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2110 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786467.081175:0:12981:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6400/0x450132973bff2109 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff2110 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786467.081196:0:12981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6400/0x450132973bff2109 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x450132973bff2110 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786467.081203:0:12981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6400/0x450132973bff2109 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x450132973bff2110 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786467.081229:0:12981:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787786467.081235:0:12981:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787786467.081260:0:12981:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787786467.081264:0:12981:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787786467.081270:0:12981:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787786467.081295:0:12981:0:(import.c:65:import_set_state_nolock()) ffff8b5208fbb800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1787786467.081384:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874629686804224:0@lo:39:umount.0 00000100:00100000:3.0:1787786467.081534:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786467.081782:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686804224 00000100:00100000:0.0:1787786467.081819:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686804224 00000100:00100000:0.0:1787786467.081881:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787786467.081898:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b510331de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874629686804224:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787786467.081925:0:7644:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff1ea1 00000100:00080000:0.0:1787786467.081933:0:7644:0:(import.c:65:import_set_state_nolock()) ffff8b523a10d000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787786467.082133:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787786467.082142:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6400/0x450132973bff2109 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x450132973bff2110 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786467.082150:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb6400 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:2.0:1787786467.082160:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6400/0x450132973bff2109 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x450132973bff2110 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786467.082168:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6400/0x450132973bff2109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x450132973bff2110 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787786467.082174:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6400/0x450132973bff2109 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x450132973bff2110 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787786467.082180:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787786467.082182:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787786467.082184:0:5835:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787786467.082210:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6400/0x450132973bff2109 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x450132973bff2110 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786467.082215:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787786467.082243:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6400/0x450132973bff2109 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x450132973bff2110 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786467.082250:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6400/0x450132973bff2109 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x450132973bff2110 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786467.082262:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786467.082263:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786467.082265:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786467.082272:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787786467.082285:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52332c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686804352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787786467.082317:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786467.082400:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686804352 00000100:00100000:1.0:1787786467.082404:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686804352 00000100:00100000:1.0:1787786467.082469:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787786467.082476:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52332c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+19:3312:x1874629686804352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787786467.082488:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786467.082501:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5201676400/0x450132973bff2110 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x450132973bff2109 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786467.082513:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786467.082548:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52332c03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:3312:x1874629686804352:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786467.082555:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787786467.082591:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52332c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686804352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787786467.083078:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b510331de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3310:x1874629686804224:12345-0@lo:39:umount.0 Request processed in 1179us (1543us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786467.083086:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1787786467.083095:0:7644:0:(genops.c:885:class_export_put()) final put ffff8b523a1e1800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1787786467.083125:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787786467.083164:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b523a1e1800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787786467.083241:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b523a10d000 for lustre-MDT0000 00000100:00080000:3.0:1787786467.083347:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b5208fbb800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787786467.083557:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874629686804224:0@lo:39:umount.0 00000100:00080000:1.0:1787786467.083618:0:12981:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787786467.083631:0:12981:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787786467.083636:0:12981:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787786467.086757:0:12981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6e00/0x450132973bff2117 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff211e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786467.086777:0:12981:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6e00/0x450132973bff2117 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff211e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786467.086784:0:12981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6e00/0x450132973bff2117 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x450132973bff211e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786467.086964:0:12981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6e00/0x450132973bff2117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x450132973bff211e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786467.087025:0:12981:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787786467.087033:0:12981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520151ae00/0x450132973bff203e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2045 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786467.087041:0:12981:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520151ae00/0x450132973bff203e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff2045 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786467.087046:0:12981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520151ae00/0x450132973bff203e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x450132973bff2045 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786467.087052:0:12981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.134@tcp lock: ffff8b520151ae00/0x450132973bff203e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x450132973bff2045 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786467.087120:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787786467.087142:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6e00/0x450132973bff2117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x450132973bff211e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786467.087148:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb6e00 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:2.0:1787786467.087152:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6e00/0x450132973bff2117 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x450132973bff211e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786467.087161:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6e00/0x450132973bff2117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x450132973bff211e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787786467.087167:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6e00/0x450132973bff2117 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x450132973bff211e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787786467.087172:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787786467.087175:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1787786467.087209:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6e00/0x450132973bff2117 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x450132973bff211e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786467.087216:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787786467.087256:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6e00/0x450132973bff2117 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x450132973bff211e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786467.087264:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6e00/0x450132973bff2117 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x450132973bff211e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786467.087278:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787786467.087282:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b520151ae00/0x450132973bff203e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x450132973bff2045 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786467.087288:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520151ae00 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:2.0:1787786467.087290:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b520151ae00/0x450132973bff203e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x450132973bff2045 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786467.087304:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b520151ae00/0x450132973bff203e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x450132973bff2045 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787786467.087311:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b520151ae00/0x450132973bff203e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x450132973bff2045 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787786467.087317:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787786467.087319:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1787786467.087331:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b520151ae00/0x450132973bff203e lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x450132973bff2045 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786467.087337:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787786467.087359:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b520151ae00/0x450132973bff203e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x450132973bff2045 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786467.087377:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786467.087379:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786467.087381:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786467.087612:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787786467.087633:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52332c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686804480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787786467.087703:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786467.087778:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52332c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686804608:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787786467.087933:0:8508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686804480 00000100:00100000:2.0:1787786467.087941:0:8508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686804480 00000100:00100000:2.0:1787786467.087988:0:8508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787786467.087997:0:8508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103292580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+18:3311:x1874629686804480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787786467.088009:0:8508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787786467.088025:0:8508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b520151a800/0x450132973bff211e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x450132973bff2117 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786467.088038:0:8508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787786467.088075:0:8508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103292580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:3311:x1874629686804480:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786467.088093:0:8508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787786467.088143:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786467.088197:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52332c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686804480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787786467.088248:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686804608 00000100:00100000:2.0:1787786467.088252:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686804608 00000100:00100000:2.0:1787786467.088286:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787786467.088293:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103290f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+17:3313:x1874629686804608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787786467.088301:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787786467.088310:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b52421d5a00/0x450132973bff2045 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x450132973bff203e expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786467.088323:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787786467.088350:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103290f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:3313:x1874629686804608:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786467.088356:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787786467.088706:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52332c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686804608:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787786467.091641:0:12981:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787786467.091657:0:12981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b520151ae00/0x450132973bff203e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x450132973bff2045 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787786467.091705:0:12981:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1787786467.091726:0:12981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7c00/0x450132973bff2340 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2347 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786467.091734:0:12981:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7c00/0x450132973bff2340 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff2347 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786467.091741:0:12981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7c00/0x450132973bff2340 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x450132973bff2347 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786467.091747:0:12981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7c00/0x450132973bff2340 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x450132973bff2347 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786467.092042:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787786467.092049:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7c00/0x450132973bff2340 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x450132973bff2347 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786467.092056:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7c00 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:2.0:1787786467.092059:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7c00/0x450132973bff2340 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x450132973bff2347 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786467.092067:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7c00/0x450132973bff2340 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x450132973bff2347 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787786467.092074:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7c00/0x450132973bff2340 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x450132973bff2347 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787786467.092079:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787786467.092088:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1787786467.092124:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7c00/0x450132973bff2340 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x450132973bff2347 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786467.092130:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1787786467.092194:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52332c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3314:1874629686804736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787786467.092274:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787786467.092341:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7c00/0x450132973bff2340 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x450132973bff2347 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786467.092352:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786467.092353:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786467.092355:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786467.095769:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786467.095872:0:12981:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1787786467.095882:0:12981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7c00/0x450132973bff2340 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x450132973bff2347 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787786467.095902:0:12981:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787786467.095919:0:12981:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520151a400/0x450132973bff1df2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff1df9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786467.095927:0:12981:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520151a400/0x450132973bff1df2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff1df9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786467.095934:0:12981:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520151a400/0x450132973bff1df2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x450132973bff1df9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786467.095941:0:12981:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.134@tcp lock: ffff8b520151a400/0x450132973bff1df2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x450132973bff1df9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786467.095986:0:12981:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787786467.095991:0:12981:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1787786467.095993:0:12981:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1787786467.096028:0:12981:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1787786467.096033:0:12981:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1787786467.096037:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787786467.096043:0:12981:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:1.0:1787786467.096050:0:12981:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8b5206362000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787786467.096056:0:12981:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8b51013a1800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787786467.096063:0:12981:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8b5237c44800 6e407027-7940-45d9-87d7-56031cd08b7a 192.168.204.34@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787786467.096068:0:12981:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8b523c204d28) has exports, disconnecting them 00000020:00080000:1.0:1787786467.096072:0:12981:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8b5206362000), last request at 1787786463 00000020:00000080:1.0:1787786467.096080:0:12981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff2006 00000100:00080000:1.0:1787786467.096097:0:12981:0:(import.c:65:import_set_state_nolock()) ffff8b5206365000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1787786467.096145:0:12981:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8b5206362000): rc 0 00000020:00000080:1.0:1787786467.096148:0:12981:0:(genops.c:885:class_export_put()) final put ffff8b5206362000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1787786467.096159:0:12981:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8b51013a1800), last request at 1787786463 00000020:00000080:1.0:1787786467.096161:0:12981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff1f3b 00000100:00080000:1.0:1787786467.096166:0:12981:0:(import.c:65:import_set_state_nolock()) ffff8b51013a2800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1787786467.096179:0:481:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5206362000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787786467.096223:0:481:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5206365000 for lustre-MDT0000 00010000:00010000:1.0:1787786467.096231:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787786467.096237:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b520151a400/0x450132973bff1df2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x450132973bff1df9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786467.096244:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520151a400 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1787786467.096253:0:7633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b520151a400/0x450132973bff1df2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x450132973bff1df9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786467.096261:0:7633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b520151a400/0x450132973bff1df2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x450132973bff1df9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787786467.096268:0:7633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b520151a400/0x450132973bff1df2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x450132973bff1df9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787786467.096274:0:7633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787786467.096277:0:7633:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787786467.096279:0:7633:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787786467.096311:0:7633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b520151a400/0x450132973bff1df2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x450132973bff1df9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786467.096318:0:7633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787786467.096338:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b520151a400/0x450132973bff1df2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x450132973bff1df9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786467.096345:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b520151a400/0x450132973bff1df2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x450132973bff1df9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786467.096359:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786467.096360:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786467.096362:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786467.096382:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686804864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787786467.096560:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686804736 00000100:00100000:3.0:1787786467.096568:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686804736 00000100:00100000:3.0:1787786467.096623:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787786467.096633:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103293480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:3314:x1874629686804736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787786467.096647:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786467.096661:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b520912c400/0x450132973bff2347 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x450132973bff2340 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786467.096672:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786467.096744:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786467.096868:0:11675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686804864 00000100:00100000:1.0:1787786467.096872:0:11675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686804864 00000100:00100000:1.0:1787786467.096900:0:11675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787786467.096907:0:11675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+16:3311:x1874629686804864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787786467.096922:0:11675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786467.096932:0:11675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5200030e00/0x450132973bff1df9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x450132973bff1df2 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786467.096943:0:11675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786467.096972:0:11675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c092c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+15:3311:x1874629686804864:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786467.096978:0:11675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787786467.097020:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686804864:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1787786467.097045:0:12981:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8b51013a1800): rc 0 00000020:00000080:1.0:1787786467.097047:0:12981:0:(genops.c:885:class_export_put()) final put ffff8b51013a1800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1787786467.097061:0:12981:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb4ac014f3ae0 00000020:00000080:1.0:1787786467.097074:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b51013a1800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787786467.097105:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b51013a2800 for lustre-MDT0000 00000100:00080000:1.0:1787786467.097127:0:12981:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1787786467.097131:0:12981:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1787786467.097143:0:12981:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787786467.097204:0:12981:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1787786467.097216:0:12981:0:(import.c:65:import_set_state_nolock()) ffff8b51013a4800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1787786467.097229:0:12981:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787786467.097231:0:12981:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1787786467.097240:0:12981:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1787786467.097309:0:12981:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1787786467.097317:0:12981:0:(import.c:65:import_set_state_nolock()) ffff8b5237c5f800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1787786467.097344:0:12981:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8b523c204d28) has no exports 00010000:00010000:2.0:1787786467.097544:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786467.097550:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786467.099259:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103293480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:3314:x1874629686804736:12345-0@lo:103:ldlm_bl.0 Request processed in 2618us (6976us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786467.099271:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787786467.099311:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874629686804992:0@lo:9:umount.0 00000100:00100000:3.0:1787786467.099373:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786467.099410:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874629686805120:0@lo:9:umount.0 00000100:00100000:3.0:1787786467.099464:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786467.099517:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686804992 00000100:00100000:3.0:1787786467.099524:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686804992 00000100:00100000:3.0:1787786467.099571:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686805120 00000100:00100000:3.0:1787786467.099574:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686805120 00000100:00100000:3.0:1787786467.099596:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787786467.099604:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b510331da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874629686804992:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787786467.099631:0:6700:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff1f88 00000100:00080000:3.0:1787786467.099640:0:6700:0:(import.c:65:import_set_state_nolock()) ffff8b5237bf5000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787786467.099673:0:6700:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1787786467.100028:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b510331da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3310:x1874629686804992:12345-0@lo:9:umount.0 Request processed in 423us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786467.100035:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787786467.100049:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787786467.100056:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874629686805120:12345-0@lo:9:umount.0 00000020:00000080:3.0:1787786467.100068:0:6700:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff206f 00000100:00080000:3.0:1787786467.100074:0:6700:0:(import.c:65:import_set_state_nolock()) ffff8b523b44f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787786467.100095:0:6700:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1787786467.100286:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3310:x1874629686805120:12345-0@lo:9:umount.0 Request processed in 230us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786467.100292:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1787786467.100314:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787786467.100318:0:5842:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787786467.100333:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786467.100338:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787786467.100366:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b51013a4800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787786467.100378:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787786467.100380:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787786467.100384:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874629686804992:0@lo:9:umount.0 00000100:00080000:3.0:1787786467.100395:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b5237c5f800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1787786467.100412:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1787786467.100414:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787786467.100417:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874629686805120:0@lo:9:umount.0 00000100:00100000:0.0:1787786467.101817:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52332c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3314:1874629686804736:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1787786467.110640:0:12981:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8b523c204d28) has no exports 00000020:00000080:1.0:1787786467.164125:0:12981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff1e4d 00000020:00000080:1.0:1787786467.164141:0:12981:0:(genops.c:885:class_export_put()) final put ffff8b523277e800/lustre-QMT0000_UUID 00000020:01000000:1.0:1787786467.164209:0:12981:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1787786467.164303:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787786467.164313:0:12981:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787786467.164317:0:12981:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8b5206793370) has no exports 00000020:00000080:0.0:1787786467.164627:0:12981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff1e46 00000020:00000080:0.0:1787786467.164633:0:12981:0:(genops.c:885:class_export_put()) final put ffff8b523d2c3000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787786467.164712:0:481:0:(genops.c:844:class_export_destroy()) destroying export ffff8b523277e800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1787786467.164779:0:481:0:(genops.c:844:class_export_destroy()) destroying export ffff8b523d2c3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787786467.166979:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787786467.166993:0:12981:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787786467.166998:0:12981:0:(genops.c:885:class_export_put()) final put ffff8b523d2ad800/lustre-QMT0000_UUID 00000020:00000080:0.0:1787786467.167011:0:12981:0:(genops.c:844:class_export_destroy()) destroying export ffff8b523d2ad800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787786467.167021:0:12981:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:2.0:1787786467.786046:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786468.362507:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52332c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686805248:0@lo:400:kworker.0 00000100:00100000:3.0:1787786468.362595:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786468.362674:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686805248 00000100:00100000:1.0:1787786468.362683:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686805248 00000100:00100000:1.0:1787786468.362728:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1787786468.362739:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5208f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:3312:x1874629686805248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786468.362935:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52332c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686805376:0@lo:400:kworker.0 00000100:00100000:2.0:1787786468.362970:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786468.362996:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787786468.363002:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b951e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874629686805504:0@lo:400:kworker.0 00000100:00100000:2.0:1787786468.363024:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786468.363055:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686805376 00000100:00100000:2.0:1787786468.363059:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686805376 00000100:00100000:2.0:1787786468.363080:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686805504 00000100:00100000:2.0:1787786468.363083:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686805504 00000100:00100000:2.0:1787786468.363101:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787786468.363106:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b952580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1874629686805376:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787786468.363113:0:5848:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787786468.363146:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b952580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1874629686805376:12345-0@lo:400:kworker.0 Request processed in 38us (175us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787786468.363168:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787786468.363184:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787786468.363189:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b951a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1874629686805504:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787786468.363194:0:5848:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787786468.363220:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b951a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3313:x1874629686805504:12345-0@lo:400:kworker.0 Request processed in 29us (194us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787786468.363226:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:2.0:1787786468.363255:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787786468.363260:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8b523b44f000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787786468.363264:0:3313:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1787786468.367710:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5208f8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1+14:3312:x1874629686805248:12345-0@lo:400:kworker.0 Request processed in 4963us (5104us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786468.367726:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1787786468.368524:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52332c1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686805248:0@lo:400:kworker.0 00000100:00080000:2.0:1787786468.381216:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8b523b44f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787786468.381230:0:3313:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 221 00000100:00080000:2.0:1787786468.381241:0:3313:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b523b44f000 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:2.0:1787786468.381285:0:3313:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5233338000 x1874629686805632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787786468.381329:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b951e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874629686805504:0@lo:400:kworker.0 00000100:00080000:2.0:1787786468.381377:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787786468.381382:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8b51013a3000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787786468.381385:0:3313:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1787786468.381389:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8b51013a3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787786468.381392:0:3313:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 202 00000100:00080000:2.0:1787786468.381412:0:3313:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b51013a3000 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:2.0:1787786468.381426:0:3313:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b523333b0c0 x1874629686805760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787786468.381453:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52332c2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686805376:0@lo:400:kworker.0 00000100:00100000:3.0:1787786468.381584:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5233338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874629686805632:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1787786468.381655:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786468.381757:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523333b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874629686805760:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1787786468.381782:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786468.385943:0:7644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686805632 00000100:00100000:0.0:1787786468.385958:0:7644:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686805632 00000100:00100000:2.0:1787786468.386041:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686805760 00000100:00100000:2.0:1787786468.386046:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686805760 00000100:00100000:0.0:1787786468.386083:0:7644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787786468.386091:0:7644:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3310:x1874629686805632:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1787786468.386111:0:7644:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787786468.387354:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787786468.387365:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1874629686805760:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:2.0:1787786468.387380:0:5848:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1787786468.387497:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1874629686805760:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 131us (5712us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787786468.387504:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:3.0:1787786468.387925:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b51013a3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787786468.387933:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787786468.387938:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523333b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874629686805760:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1787786468.392758:0:7644:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3310:x1874629686805632:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 6657us (11092us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787786468.392773:0:7644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1787786468.393092:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b523b44f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787786468.393098:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787786468.393103:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5233338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874629686805632:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:3.0:1787786468.809950:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786469.835717:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787786470.452160:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787786470.452169:0:6723:0:(genops.c:885:class_export_put()) final put ffff8b5237bf4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787786470.452271:0:481:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5237bf4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000001:00100000:2.0:1787786470.452455:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6e407027-7940-45d9-87d7-56031cd08b7a 00000001:00080000:2.0:1787786470.452468:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1787786470.452471:0:5868:0:(genops.c:885:class_export_put()) final put ffff8b5237c44800/6e407027-7940-45d9-87d7-56031cd08b7a 00000020:00000080:3.0:1787786470.452563:0:481:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5237bf5000 for lustre-OST0000 00000020:00000080:3.0:1787786470.452668:0:481:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5237c44800/6e407027-7940-45d9-87d7-56031cd08b7a for lustre-MDT0000 00000020:00000080:3.0:1787786470.452775:0:481:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5237c45000 for lustre-MDT0000 00010000:00010000:2.0:1787786470.858043:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787786471.475991:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787786471.476000:0:7647:0:(genops.c:885:class_export_put()) final put ffff8b523b44a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787786471.476083:0:481:0:(genops.c:844:class_export_destroy()) destroying export ffff8b523b44a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1787786471.476137:0:481:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b523b44f800 for lustre-OST0001 00010000:00010000:3.0:1787786471.881971:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786472.905964:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787786473.227523:0:12981:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8b52337a6240 - data ffff8b520e6efd80/ffff8b5208f85800 00000020:01000000:2.0:1787786473.229005:0:12981:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8b522cc51960 - data ffff8b520e7581b0/ffff8b52091a3c00 00000001:00000004:2.0:1787786473.238182:0:12981:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1787786473.341696:0:12981:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787786473.341716:0:12981:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1787786473.341732:0:12981:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787786473.341735:0:12981:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787786473.342910:0:7062:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787786473.342917:0:7062:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1787786473.342928:0:7062:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787786473.343920:0:12981:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787786473.343926:0:12981:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1787786473.343942:0:12981:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787786473.343944:0:12981:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787786473.348174:0:8123:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787786473.348184:0:8123:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1787786473.348209:0:8123:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1787786473.445493:0:12981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff1e15 00000020:00000080:3.0:1787786473.445510:0:12981:0:(genops.c:885:class_export_put()) final put ffff8b523a1e6000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787786473.445597:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b523a1e6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787786473.446771:0:12981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff1e2a 00000020:00000080:3.0:1787786473.446780:0:12981:0:(genops.c:885:class_export_put()) final put ffff8b523c21c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787786473.446813:0:12981:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1787786473.446820:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787786473.446829:0:12981:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787786473.446834:0:12981:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8b523c2019b8) has no exports 00000020:00000080:1.0:1787786473.446839:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b523c21c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:3.0:1787786473.447008:0:12981:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1787786473.447016:0:12981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff2068 00000020:00000080:3.0:1787786473.447022:0:12981:0:(genops.c:885:class_export_put()) final put ffff8b521376e000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1787786473.447035:0:12981:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787786473.447039:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787786473.447045:0:12981:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787786473.447047:0:12981:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8b5237ba4d28) has no exports 00000020:00000080:3.0:1787786473.447053:0:12981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff2061 00000020:00000080:1.0:1787786473.447055:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b521376e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787786473.447058:0:12981:0:(genops.c:885:class_export_put()) final put ffff8b5237c5f000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787786473.447078:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5237c5f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787786473.447413:0:12981:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787786473.447417:0:12981:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787786473.447422:0:12981:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1787786473.447428:0:12981:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787786473.447430:0:12981:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787786473.449570:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787786473.449588:0:12981:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787786473.449595:0:12981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff1f81 00000020:00000080:3.0:1787786473.449605:0:12981:0:(genops.c:885:class_export_put()) final put ffff8b5237bf3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787786473.449720:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5237c5f800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787786473.449728:0:8:0:(genops.c:885:class_export_put()) final put ffff8b5237c59000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787786473.449731:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5237c59000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1787786473.449740:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1787786473.449897:0:12981:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1787786473.449902:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787786473.449908:0:12981:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1787786473.449912:0:12981:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8b5209114d28) has no exports 00000020:00000080:3.0:1787786473.449919:0:12981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff1f7a 00000020:00000080:3.0:1787786473.449924:0:12981:0:(genops.c:885:class_export_put()) final put ffff8b51013a5000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787786473.450212:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5237bf3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1787786473.450226:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b51013a5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1787786473.450345:0:12981:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1787786473.450350:0:12981:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787786473.450355:0:12981:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1787786473.450361:0:12981:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787786473.450364:0:12981:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787786473.450404:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787786473.450410:0:12981:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787786473.450451:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787786473.450455:0:12981:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787786473.450458:0:12981:0:(genops.c:885:class_export_put()) final put ffff8b523a1e4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787786473.450461:0:12981:0:(genops.c:844:class_export_destroy()) destroying export ffff8b523a1e4000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1787786473.450466:0:12981:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787786473.450590:0:12981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff1e31 00000020:00000080:3.0:1787786473.450595:0:12981:0:(genops.c:885:class_export_put()) final put ffff8b523c21b800/lustre-MDD0000_UUID 00000020:01000000:3.0:1787786473.450599:0:12981:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1787786473.450602:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787786473.450605:0:12981:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787786473.450608:0:12981:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8b523c203370) has no exports 00000020:00000080:3.0:1787786473.450624:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787786473.450627:0:12981:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1787786473.450630:0:12981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff1e38 00000020:00000080:3.0:1787786473.450633:0:12981:0:(genops.c:885:class_export_put()) final put ffff8b523c21b000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1787786473.450639:0:12981:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8b5207b73000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1787786473.450642:0:12981:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b5207b73000 3 00000020:01000004:3.0:1787786473.450645:0:12981:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8b5207b73000 from lustre-MDT0000 00000020:00000080:3.0:1787786473.450661:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787786473.450670:0:12981:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1787786473.450673:0:12981:0:(genops.c:885:class_export_put()) final put ffff8b523a1e6800/lustre-MDT0000_UUID 00000020:00000080:3.0:1787786473.450675:0:12981:0:(genops.c:844:class_export_destroy()) destroying export ffff8b523a1e6800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1787786473.450682:0:12981:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1787786473.450707:0:12981:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1787786473.450710:0:12981:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1787786473.450713:0:12981:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1787786473.450715:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787786473.450718:0:12981:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1787786473.450724:0:12981:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8b520899b800 a44a06f2-32e6-4870-9ef4-9f12b11e8ae1 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787786473.450729:0:12981:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8b5206794d28) has exports, disconnecting them 00000020:00080000:3.0:1787786473.450733:0:12981:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8b520899b800), last request at 1787786257 00000020:00000080:3.0:1787786473.450746:0:12981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff1dd6 00000020:00010000:3.0:1787786473.450750:0:12981:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8b520899b800: total 2 00000100:00080000:3.0:1787786473.450754:0:12981:0:(import.c:65:import_set_state_nolock()) ffff8b520899b000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787786473.450772:0:12981:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8b520899b800): rc 0 00000020:00080000:3.0:1787786473.450776:0:12981:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8b5206794d28) has no exports 00000020:00000080:1.0:1787786473.451179:0:481:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b51013a4800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787786473.451188:0:481:0:(genops.c:885:class_export_put()) final put ffff8b51013a7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787786473.451190:0:481:0:(genops.c:844:class_export_destroy()) destroying export ffff8b51013a7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1787786473.451195:0:481:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787786473.451284:0:481:0:(genops.c:844:class_export_destroy()) destroying export ffff8b523c21b800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1787786473.451288:0:481:0:(genops.c:885:class_export_put()) final put ffff8b523a1e0800/lustre-MDD0000_UUID 00000020:00000080:1.0:1787786473.451290:0:481:0:(genops.c:844:class_export_destroy()) destroying export ffff8b523a1e0800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1787786473.451294:0:481:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1787786473.451465:0:481:0:(genops.c:844:class_export_destroy()) destroying export ffff8b523c21b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:1.0:1787786473.451506:0:5841:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8b521020c200:5841] 2 exiting: rc = 0 00000100:00100000:1.0:1787786473.451602:0:5839:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8b521020c800:5839] 0 exiting: rc = 1 00000020:00010000:3.0:1787786473.451893:0:5835:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8b520899b800: total 0 00010000:00010000:3.0:1787786473.451918:0:5835:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8b520899b800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1787786473.451947:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b520912d000/0x450132973bff20e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x450132973bff20df expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786473.451965:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b520151aa00/0x450132973bff20f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x450132973bff20ed expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786473.451983:0:5840:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8b520631e400:5840] 1 exiting: rc = 0 00010000:00010000:3.0:1787786473.451999:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5201677800/0x450132973bff2102 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x450132973bff20fb expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786473.452012:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b520151b000/0x450132973bff212c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x450132973bff2125 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786473.452043:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b523bcb6600/0x450132973bff232b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x450132973bff2324 expref: 5 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786473.452054:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5201676c00/0x450132973bff2339 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x450132973bff2332 expref: 4 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786473.452068:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5200030c00/0x450132973bff1eee lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x450132973bff1ee7 expref: 3 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786473.452080:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b520912de00/0x450132973bff20d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x450132973bff20d1 expref: 2 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786473.452090:0:5835:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8b520899b800, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1787786473.452102:0:5835:0:(genops.c:885:class_export_put()) final put ffff8b520899b800/a44a06f2-32e6-4870-9ef4-9f12b11e8ae1 00010000:00010000:3.0:1787786473.452121:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786473.452123:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786473.452125:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787786473.452283:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b520899b800/a44a06f2-32e6-4870-9ef4-9f12b11e8ae1 for MGS 00000020:00000080:0.0:1787786473.452325:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b520899b000 for MGS 00000100:00100000:1.0:1787786473.452391:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452400:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452407:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452412:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452418:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452424:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452429:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452435:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452450:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452458:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452463:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452469:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452474:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452479:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452485:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452491:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452497:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452503:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452509:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452515:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452521:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452527:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452532:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452537:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452543:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452548:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452555:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452560:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452566:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452572:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452577:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452583:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452597:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452602:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452606:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452612:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452617:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452624:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452629:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452635:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452640:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452645:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452651:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452656:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452661:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452666:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452671:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452676:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452681:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452685:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452690:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452695:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452701:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452705:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452710:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452716:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452721:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452726:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452731:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452738:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452744:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452749:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452754:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.452760:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1787786473.453415:0:12981:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787786473.453419:0:12981:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1787786473.455490:0:12981:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8b5208ce13c0 - data ffff8b522d68d1b0/ffff8b5232f66800 00000020:01000000:1.0:1787786473.455631:0:12981:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8b52134e8f00 - data ffff8b520e6edd80/ffff8b520916fc00 00000020:00000080:1.0:1787786473.456374:0:12981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff1dba 00000020:00000080:1.0:1787786473.456383:0:12981:0:(genops.c:885:class_export_put()) final put ffff8b52117b8000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1787786473.456403:0:12981:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8b5207b73000 from MGS, refs=2 00000020:01000004:1.0:1787786473.456407:0:12981:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b5207b73000 2 00000020:01000004:1.0:1787786473.456410:0:12981:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8b5207b73000 from MGS 00000020:00000080:1.0:1787786473.456431:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787786473.456510:0:481:0:(genops.c:844:class_export_destroy()) destroying export ffff8b52117b8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787786473.456539:0:12981:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1787786473.456543:0:12981:0:(genops.c:885:class_export_put()) final put ffff8b5203bd3800/MGS 00000020:00000080:1.0:1787786473.456545:0:12981:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5203bd3800/MGS for MGS 00000020:01000000:1.0:1787786473.456551:0:12981:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1787786473.456610:0:12981:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1787786473.456614:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787786473.456620:0:12981:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1787786473.456628:0:12981:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8b5208fbe800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1787786473.456635:0:12981:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8b5209120000) has exports, disconnecting them 00000020:00080000:1.0:1787786473.456640:0:12981:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8b5208fbe800), last request at 1787786258 00000020:00000080:1.0:1787786473.456644:0:12981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff1e85 00000020:00080000:1.0:1787786473.456655:0:12981:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8b5208fbe800): rc 0 00000020:00000080:1.0:1787786473.456659:0:12981:0:(genops.c:885:class_export_put()) final put ffff8b5208fbe800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787786473.456900:0:481:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5208fbe800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787786473.461652:0:12981:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787786473.461662:0:12981:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787786473.461667:0:12981:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787786473.461674:0:12981:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787786473.461925:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787786473.461933:0:12981:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787786473.461952:0:12981:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b5207b73000 1 00000020:00000080:0.0:1787786473.461959:0:12981:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff1dac 00000020:00000080:0.0:1787786473.461968:0:12981:0:(genops.c:885:class_export_put()) final put ffff8b5203bd5800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787786473.463022:0:481:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5208fbb800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1787786473.463033:0:481:0:(genops.c:885:class_export_put()) final put ffff8b5208fdc800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787786473.463036:0:481:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5208fdc800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1787786473.463044:0:481:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:0.0:1787786473.463554:0:12981:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787786473.463561:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787786473.463569:0:12981:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787786473.463575:0:12981:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8b52090a99b8) has no exports 00000020:00000080:3.0:1787786473.463886:0:481:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5203bd5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00080000:2.0:1787786473.486183:0:481:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787786473.486191:0:481:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787786473.486195:0:481:0:(import.c:65:import_set_state_nolock()) ffff8b51013a3000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787786473.486202:0:481:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 394 00000100:00080000:2.0:1787786473.486207:0:481:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787786473.486214:0:481:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b51013a3000 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:2.0:1787786473.486234:0:481:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b523333b840 x1874629686806016/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787786473.486262:0:481:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1787786473.486266:0:481:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787786473.486267:0:481:0:(import.c:65:import_set_state_nolock()) ffff8b523b44f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787786473.486271:0:481:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 394 00000100:00080000:2.0:1787786473.486273:0:481:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787786473.486277:0:481:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b523b44f000 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:2.0:1787786473.486290:0:481:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5233339a40 x1874629686806144/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787786473.486332:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5233338f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686805888:0@lo:400:kworker.0 00000400:00000100:2.0:1787786473.486385:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874629686805888 offset 0 length 224: 4 00000100:00100000:2.0:1787786473.486461:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523333b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874629686806016:0@lo:38:kworker.0 00000100:00100000:2.0:1787786473.486495:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786473.486516:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5233339a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874629686806144:0@lo:38:kworker.0 00000100:00100000:2.0:1787786473.486536:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786473.486569:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686806016 00000100:00100000:2.0:1787786473.486577:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686806016 00000100:00100000:2.0:1787786473.486634:0:8713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686806144 00000100:00100000:2.0:1787786473.486637:0:8713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686806144 00000100:00100000:2.0:1787786473.486653:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787786473.486660:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5233339680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3310:x1874629686806016:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787786473.486678:0:8713:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787786473.486717:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5233339680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3310:x1874629686806016:12345-0@lo:38:kworker.0 Request processed in 56us (221us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787786473.486724:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1787786473.486744:0:8713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1787786473.486748:0:8713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523333bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3310:x1874629686806144:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1787786473.486756:0:8713:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787786473.486777:0:8713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523333bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3310:x1874629686806144:12345-0@lo:38:kworker.0 Request processed in 27us (240us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787786473.486782:0:8713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00080000:2.0:1787786473.486868:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b51013a3000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787786473.486872:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787786473.486876:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523333b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874629686806016:0@lo:38:kworker.0 00000100:00080000:2.0:1787786473.486884:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b523b44f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787786473.486887:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787786473.486890:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5233339a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874629686806144:0@lo:38:kworker.0 00000020:00000080:3.0:1787786473.565502:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787786473.565518:0:12981:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1787786473.565524:0:12981:0:(genops.c:885:class_export_put()) final put ffff8b5207b75800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787786473.565529:0:12981:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5207b75800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1787786473.565548:0:12981:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1787786473.565662:0:12981:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8b5207b77000 00000020:01000000:3.0:1787786473.565685:0:12981:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1787786473.565689:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787786473.565693:0:12981:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787786473.565697:0:12981:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8b52090ab370) has no exports 00000100:00100000:1.0:1787786473.565851:0:7644:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8b52329b2c00:7644] 3 exiting: rc = 0 00000100:00100000:2.0:1787786473.566859:0:8713:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8b5237b09600:8713] 4 exiting: rc = 0 00000100:00100000:1.0:1787786473.566882:0:5847:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8b52063b3000:5847] 1 exiting: rc = 0 00000100:00100000:2.0:1787786473.566951:0:5846:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8b5207b4b400:5846] 0 exiting: rc = 1 00000100:00100000:0.0:1787786473.568949:0:5848:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8b52063b2600:5848] 2 exiting: rc = 0 00000100:00100000:3.0:1787786473.569119:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569127:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569133:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569138:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569143:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569148:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569153:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569158:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569164:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569169:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569175:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569181:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569185:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569191:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569210:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569217:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569222:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569227:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569232:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569237:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569242:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569248:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569253:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569258:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569263:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569269:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569275:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569280:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569285:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569320:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569329:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569334:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569340:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569346:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569352:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569359:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569366:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569371:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569377:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569382:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569389:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569395:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569401:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569406:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569411:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569417:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569422:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569428:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569434:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569440:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569446:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569451:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569459:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569467:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569474:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569480:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569487:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569492:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569498:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569506:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569512:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569519:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569526:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.569534:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786473.573680:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8b5210203000:5849] 0 exiting: rc = 1 00000100:00100000:1.0:1787786473.573939:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8b5210202e00:5850] 1 exiting: rc = 0 00000100:00100000:3.0:1787786473.574050:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574057:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574062:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574067:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574072:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574076:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574083:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574089:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574094:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574100:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574104:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574111:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574119:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574125:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574130:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574135:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574139:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574143:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574148:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574152:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574158:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574163:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574168:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574172:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574178:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574183:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574189:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574195:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574201:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574205:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574211:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574217:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574222:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574227:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574231:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574251:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574256:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574261:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574267:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574272:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574278:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574284:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574289:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574294:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574308:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574313:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574318:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574323:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574328:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574334:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574340:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574347:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574354:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574360:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574367:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574374:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574381:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574389:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574396:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574402:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574407:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574413:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574418:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.574424:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.575812:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8b52063b2c00:5851] 0 exiting: rc = 1 00000100:00100000:0.0:1787786473.576129:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8b52063b2e00:5852] 1 exiting: rc = 0 00000100:00100000:3.0:1787786473.576205:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576214:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576220:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576226:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576232:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576239:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576254:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576273:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576281:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576288:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576304:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576311:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576331:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576340:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576345:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576351:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576358:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576365:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576372:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576378:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576385:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576391:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576521:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576531:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576553:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576561:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576568:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576574:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576580:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576586:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576592:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576598:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576604:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576610:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576615:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576621:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576641:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576649:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576657:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576663:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576669:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576682:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576688:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576695:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576702:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576708:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576716:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576722:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576741:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576748:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576754:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576761:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576767:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576774:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576781:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576787:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576811:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576818:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576824:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576831:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576854:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576862:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576871:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.576877:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.587574:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8b5207b98200:5853] 0 exiting: rc = 1 00000100:00100000:0.0:1787786473.591908:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8b5209104200:5854] 1 exiting: rc = 0 00000100:00100000:1.0:1787786473.591990:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592000:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592010:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592017:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592024:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592030:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592047:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592052:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592058:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592064:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592069:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592075:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592080:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592086:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592091:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592097:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592102:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592108:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592113:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592119:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592124:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592129:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592134:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592139:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592145:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592155:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592161:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592166:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592172:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592177:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592223:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592231:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592236:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592241:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592248:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592254:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592259:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592264:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592270:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592275:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592279:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592292:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592307:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592312:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592317:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592323:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592329:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592334:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592340:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592344:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592349:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592354:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592359:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592364:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592369:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592373:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592378:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592383:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592387:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592391:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592397:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592411:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592415:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592421:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.592829:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8b5207b98c00:5855] 0 exiting: rc = 1 00000100:00100000:0.0:1787786473.593046:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8b5209104c00:5856] 1 exiting: rc = 0 00000100:00100000:1.0:1787786473.593129:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593135:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593140:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593145:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593150:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593156:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593161:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593166:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593172:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593178:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593183:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593197:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593202:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593208:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593214:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593219:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593225:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593230:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593236:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593242:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593247:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593252:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593258:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593262:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593267:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593272:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593276:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593280:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593285:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593290:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593305:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593310:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593315:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593320:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593325:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593330:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593334:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593340:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593346:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593351:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593357:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593362:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593368:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593373:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593379:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593384:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593396:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593408:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593413:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593417:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593422:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593427:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593432:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593437:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593442:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593447:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593452:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593457:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593462:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593467:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593472:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593478:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593483:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.593488:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.593910:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8b5209105a00:5857] 0 exiting: rc = 1 00000100:00100000:0.0:1787786473.594014:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8b52182a9600:5858] 1 exiting: rc = 0 00000100:00100000:1.0:1787786473.594098:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594105:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594111:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594116:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594122:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594127:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594132:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594137:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594143:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594148:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594154:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594158:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594163:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594169:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594174:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594179:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594185:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594199:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594204:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594210:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594215:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594220:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594226:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594231:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594237:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594242:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594248:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594253:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594258:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594263:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594268:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594272:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594277:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594281:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594286:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594291:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594307:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594313:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594318:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594323:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594329:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594334:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594340:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594345:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594351:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594356:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594362:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594367:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594373:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594379:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594384:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594389:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594409:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594414:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594418:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594423:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594428:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594433:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594438:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594443:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594448:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594453:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594459:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.594465:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786473.595725:0:5859:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8b52182a6400:5859] 0 exiting: rc = 1 00000100:00100000:0.0:1787786473.595965:0:5860:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8b522cc59800:5860] 1 exiting: rc = 0 00000100:00100000:2.0:1787786473.596667:0:5861:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8b522cc58c00:5861] 2 exiting: rc = 0 00000100:00100000:1.0:1787786473.597075:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597084:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597114:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597127:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597137:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597142:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597148:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597153:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597160:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597166:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597172:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597179:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597185:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597191:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597197:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597203:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597209:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597221:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597228:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597235:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597242:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597249:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597255:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597271:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597277:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597282:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597313:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597320:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597326:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597332:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597338:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597344:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597351:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597356:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597363:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597369:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597375:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597381:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597387:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597393:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597407:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597413:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597418:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597424:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597429:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597434:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597440:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597445:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597451:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597456:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597478:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597485:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597491:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597496:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597502:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597508:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597514:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597520:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597537:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597544:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597550:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597559:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597566:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787786473.597572:0:12981:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787786473.602272:0:12981:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787786473.602285:0:12981:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1787786473.602291:0:12981:0:(genops.c:885:class_export_put()) final put ffff8b5212c4e800/MDS_uuid 00000020:00000080:1.0:1787786473.602304:0:12981:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5212c4e800/MDS_uuid for MDS 00000020:01000000:1.0:1787786473.602311:0:12981:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1787786473.602459:0:12981:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1787786473.929893:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786474.953917:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786475.977917:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787786476.577876:0:13135:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787786476.588977:0:13135:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787786476.589164:0:13135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b5201676a00/0x450132973bff20ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff20f4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786476.589179:0:13135:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b5201676a00/0x450132973bff20ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff20f4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786476.589200:0:13135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b5201676a00/0x450132973bff20ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x450132973bff20f4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786476.589207:0:13135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.134@tcp lock: ffff8b5201676a00/0x450132973bff20ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x450132973bff20f4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786476.589228:0:13135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787786476.589233:0:13135:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787786476.589270:0:13135:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787786476.589275:0:13135:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787786476.589282:0:13135:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787786476.589288:0:13135:0:(import.c:65:import_set_state_nolock()) ffff8b51013a3000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1787786476.589293:0:13135:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787786476.589295:0:13135:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787786476.589299:0:13135:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787786476.589592:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787786476.589600:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b5201676a00/0x450132973bff20ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x450132973bff20f4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786476.589610:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5201676a00 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1787786476.589613:0:7633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b5201676a00/0x450132973bff20ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x450132973bff20f4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786476.589623:0:7633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b5201676a00/0x450132973bff20ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x450132973bff20f4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787786476.589630:0:7633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b5201676a00/0x450132973bff20ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x450132973bff20f4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787786476.589649:0:7633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787786476.589652:0:7633:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787786476.589655:0:7633:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787786476.589692:0:7633:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b5201676a00/0x450132973bff20ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x450132973bff20f4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786476.589699:0:7633:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787786476.589746:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b5201676a00/0x450132973bff20ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x450132973bff20f4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786476.589753:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b5201676a00/0x450132973bff20ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x450132973bff20f4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786476.589765:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786476.589768:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786476.589769:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786476.589780:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686806272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787786476.589870:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786476.591530:0:11675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686806272 00000100:00100000:1.0:1787786476.591542:0:11675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686806272 00000100:00100000:1.0:1787786476.591587:0:11675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787786476.591595:0:11675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5211bf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3312:x1874629686806272:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787786476.591602:0:11675:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787786476 with bad export cookie 4972311088721763798 00010000:00010000:3.0:1787786476.595426:0:13135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520151b600/0x450132973bff20fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2102 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786476.596398:0:13135:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520151b600/0x450132973bff20fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff2102 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786476.596407:0:13135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520151b600/0x450132973bff20fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x450132973bff2102 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786476.596413:0:13135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.134@tcp lock: ffff8b520151b600/0x450132973bff20fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x450132973bff2102 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786476.597090:0:13135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787786476.597127:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787786476.597134:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b520151b600/0x450132973bff20fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x450132973bff2102 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786476.597144:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520151b600 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:3.0:1787786476.597148:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b520151b600/0x450132973bff20fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x450132973bff2102 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786476.597158:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b520151b600/0x450132973bff20fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x450132973bff2102 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787786476.597165:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b520151b600/0x450132973bff20fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x450132973bff2102 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786476.597170:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787786476.597172:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:3.0:1787786476.597208:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b520151b600/0x450132973bff20fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x450132973bff2102 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786476.597214:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787786476.597251:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b520151b600/0x450132973bff20fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x450132973bff2102 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786476.597258:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b520151b600/0x450132973bff20fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x450132973bff2102 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786476.597272:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786476.597273:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786476.597275:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786476.597297:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686806400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787786476.599222:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786476.599338:0:8508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686806400 00000100:00100000:3.0:1787786476.599346:0:8508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686806400 00000100:00100000:3.0:1787786476.599382:0:8508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787786476.599391:0:8508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3313:x1874629686806400:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1787786476.599397:0:8508:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787786476 with bad export cookie 4972311088721763798 00000100:00100000:3.0:1787786476.600621:0:8508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3313:x1874629686806400:12345-0@lo:103:ldlm_bl.0 Request processed in 1224us (1396us total) trans 0 rc -107/-107 00000100:00100000:3.0:1787786476.600633:0:8508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1787786476.601537:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.134@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787786476.601543:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8b5212c49000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1787786476.601547:0:3313:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:3.0:1787786476.604017:0:13135:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff2332 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff2339 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786476.604037:0:13135:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff2332 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff2339 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786476.604044:0:13135:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff2332 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x450132973bff2339 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786476.604051:0:13135:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff2332 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x450132973bff2339 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786476.604075:0:13135:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787786476.604082:0:13135:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1787786476.604087:0:13135:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787786476.604114:0:13135:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787786476.604118:0:13135:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:3.0:1787786476.604130:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787786476.604136:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff2332 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x450132973bff2339 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786476.604144:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912d800 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:3.0:1787786476.604161:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff2332 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x450132973bff2339 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786476.604170:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff2332 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x450132973bff2339 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787786476.604178:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff2332 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x450132973bff2339 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786476.604184:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787786476.604186:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787786476.604188:0:5835:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:00000080:2.0:1787786476.606877:0:13135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787786476.606891:0:13135:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787786476.606896:0:13135:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8b52091219b8) has no exports 00000020:00080000:2.0:1787786476.606941:0:13135:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8b52091219b8) has no exports 00000020:01000000:2.0:1787786476.610893:0:13135:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8b5208ce1240 - data ffff8b522d6de870/ffff8b520635e400 00000020:01000000:2.0:1787786476.612687:0:13135:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8b5206d056c0 - data ffff8b520e76c948/ffff8b5237a43000 00000100:00080000:0.0:1787786476.619221:0:3313:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.134@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1787786476.619227:0:3313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787786476.619249:0:3313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8b5233338f00 x1874629686805888/t0(0) o400->MGC192.168.204.134@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787786489 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786476.619267:0:3313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8b5237c0a1c0 x1874629686806272/t0(0) o103->MGC192.168.204.134@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787786492 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786476.619279:0:3313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8b523b4d4b40 x1874629686806400/t0(0) o103->MGC192.168.204.134@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787786492 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787786476.619289:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787786476.619310:0:3313:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787786476.619312:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:3.0:1787786476.619625:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff2332 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x450132973bff2339 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786476.619635:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787786476.619656:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff2332 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x450132973bff2339 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786476.619664:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff2332 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x450132973bff2339 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786476.619682:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786476.619684:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786476.619686:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786476.619706:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:0:1874629686806528:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787786476.619756:0:3313:0:(import.c:65:import_set_state_nolock()) ffff8b5212c49000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787786476.619762:0:3313:0:(import.c:510:import_select_connection()) MGC192.168.204.134@tcp: connect to NID 0@lo last attempt 184 00000100:00080000:0.0:1787786476.619770:0:3313:0:(import.c:624:import_select_connection()) MGC192.168.204.134@tcp: import ffff8b5212c49000 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:0.0:1787786476.619835:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3312:1874629686806272:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787786476.619874:0:3313:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5103292d00 x1874629686806656/t0(0) o250->MGC192.168.204.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787786476.619904:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103292d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3310:1874629686806656:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:0.0:1787786476.619964:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874629686806656 offset 0 length 520: 4 00000100:00100000:0.0:1787786476.620150:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3313:1874629686806400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787786476.622146:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5233338f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3311:1874629686805888:0@lo:400:kworker.0 00000400:00000100:1.0:1787786476.626848:0:11675:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1874629686806272 offset 224 length 224: 4 00000100:00100000:1.0:1787786476.626878:0:11675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5211bf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0+-99:3312:x1874629686806272:12345-0@lo:103:ldlm_bl.0 Request processed in 35280us (37005us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787786476.626890:0:11675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00100000:10000000:2.0:1787786476.639204:0:13135:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787786476.673316:0:13135:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff1f0a 00000020:00000080:2.0:1787786476.673327:0:13135:0:(genops.c:885:class_export_put()) final put ffff8b52116e1800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1787786476.673438:0:13135:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8b5206233000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1787786476.673442:0:13135:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b5206233000 2 00000020:01000004:2.0:1787786476.673445:0:13135:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8b5206233000 from lustre-OST0000 00000020:00000080:2.0:1787786476.673481:0:13135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787786476.673489:0:13135:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1787786476.673492:0:13135:0:(genops.c:885:class_export_put()) final put ffff8b52116e1000/lustre-OST0000_UUID 00000020:00000080:2.0:1787786476.673494:0:13135:0:(genops.c:844:class_export_destroy()) destroying export ffff8b52116e1000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1787786476.673501:0:13135:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787786476.673538:0:13135:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1787786476.673542:0:13135:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787786476.673545:0:13135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787786476.673549:0:13135:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787786476.673556:0:13135:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8b51013a4000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787786476.673562:0:13135:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8b523c200000) has exports, disconnecting them 00000020:00080000:2.0:1787786476.673567:0:13135:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8b51013a4000), last request at 1787786275 00000020:00000080:2.0:1787786476.673571:0:13135:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff1f34 00000020:00080000:2.0:1787786476.673580:0:13135:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8b51013a4000): rc 0 00000020:00000080:2.0:1787786476.673584:0:13135:0:(genops.c:885:class_export_put()) final put ffff8b51013a4000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787786476.673888:0:481:0:(genops.c:844:class_export_destroy()) destroying export ffff8b52116e1800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787786476.674418:0:481:0:(genops.c:844:class_export_destroy()) destroying export ffff8b51013a4000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1787786476.682915:0:13135:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1787786476.682924:0:13135:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787786476.682929:0:13135:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787786476.682937:0:13135:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787786476.683107:0:13135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787786476.683117:0:13135:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1787786476.683124:0:13135:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b5206233000 1 00000020:00000080:0.0:1787786476.683131:0:13135:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff1ec4 00000020:00000080:0.0:1787786476.683141:0:13135:0:(genops.c:885:class_export_put()) final put ffff8b523277d000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1787786476.683147:0:13135:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1787786476.683152:0:13135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787786476.683156:0:13135:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787786476.683160:0:13135:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8b5206790000) has no exports 00000020:00000080:1.0:1787786476.683503:0:481:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b51013a3000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787786476.683511:0:481:0:(genops.c:885:class_export_put()) final put ffff8b5237bf4000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787786476.683515:0:481:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5237bf4000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787786476.683522:0:481:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787786476.683583:0:481:0:(genops.c:844:class_export_destroy()) destroying export ffff8b523277d000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787786476.708130:0:13135:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787786476.708148:0:13135:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787786476.708154:0:13135:0:(genops.c:885:class_export_put()) final put ffff8b5206234800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787786476.708158:0:13135:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5206234800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787786476.708185:0:13135:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787786476.708665:0:13135:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8b5206230800 00000020:02000400:0.0:1787786476.708736:0:13135:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1787786477.002992:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786478.026577:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787786478.604033:0:481:0:(pinger.c:229:ptlrpc_pinger_process_import()) a44a06f2-32e6-4870-9ef4-9f12b11e8ae1->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787786478.604044:0:481:0:(pinger.c:247:ptlrpc_pinger_process_import()) a44a06f2-32e6-4870-9ef4-9f12b11e8ae1->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787786478.604046:0:481:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787786478.604050:0:481:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787786478.604054:0:481:0:(import.c:65:import_set_state_nolock()) ffff8b523b44f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787786478.604062:0:481:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 399 00000100:00080000:0.0:1787786478.604068:0:481:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787786478.604074:0:481:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b523b44f000 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:0.0:1787786478.604111:0:481:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5103290b40 x1874629686806784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787786478.604179:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103290b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874629686806784:0@lo:38:kworker.0 00000400:00000100:0.0:1787786478.604244:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874629686806784 offset 0 length 520: 4 00010000:00010000:3.0:1787786479.050440:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787786479.508454:0:13285:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787786479.519030:0:13285:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1787786479.519109:0:13285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7200/0x450132973bff20d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff20d8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786479.519124:0:13285:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7200/0x450132973bff20d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff20d8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786479.519132:0:13285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7200/0x450132973bff20d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x450132973bff20d8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786479.519139:0:13285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7200/0x450132973bff20d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x450132973bff20d8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786479.519160:0:13285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787786479.519165:0:13285:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787786479.519201:0:13285:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787786479.519213:0:13285:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8b5103290b40 x1874629686806784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787786498 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786479.519234:0:13285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787786479.519240:0:13285:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787786479.519245:0:13285:0:(import.c:65:import_set_state_nolock()) ffff8b523b44f000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787786479.519249:0:13285:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787786479.519252:0:13285:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8b5103290b40 x1874629686806784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787786498 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786479.519259:0:13285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787786479.519262:0:13285:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00010000:00010000:1.0:1787786479.519347:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787786479.519354:0:7633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7200/0x450132973bff20d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x450132973bff20d8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786479.519372:0:7633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7200 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1787786479.519375:0:7633:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7200/0x450132973bff20d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x450132973bff20d8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786479.519383:0:7633:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7200/0x450132973bff20d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x450132973bff20d8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787786479.519390:0:7633:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7200/0x450132973bff20d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x450132973bff20d8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787786479.519396:0:7633:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787786479.519399:0:7633:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787786479.519402:0:7633:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787786479.519413:0:7633:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8b5212c49000 00010000:00010000:1.0:1787786479.519418:0:7633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7200/0x450132973bff20d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x450132973bff20d8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786479.519424:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7200/0x450132973bff20d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x450132973bff20d8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786479.519434:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786479.519436:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786479.519438:0:7633:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786479.519628:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103290b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874629686806784:0@lo:38:kworker.0 00010000:00010000:3.0:1787786479.522266:0:13285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6c00/0x450132973bff20df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff20e6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786479.522284:0:13285:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6c00/0x450132973bff20df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff20e6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786479.522304:0:13285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6c00/0x450132973bff20df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x450132973bff20e6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786479.522311:0:13285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6c00/0x450132973bff20df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x450132973bff20e6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786479.522332:0:13285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787786479.522339:0:13285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b5201677a00/0x450132973bff2324 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff232b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786479.522345:0:13285:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b5201677a00/0x450132973bff2324 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff232b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786479.522350:0:13285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b5201677a00/0x450132973bff2324 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x450132973bff232b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786479.522356:0:13285:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.134@tcp lock: ffff8b5201677a00/0x450132973bff2324 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x450132973bff232b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786479.522371:0:13285:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787786479.522375:0:13285:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1787786479.522394:0:13285:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1787786479.522397:0:13285:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1787786479.522401:0:13285:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787786479.522406:0:13285:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787786479.522410:0:13285:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8b5209124d28) has no exports 00000020:00080000:3.0:1787786479.522434:0:13285:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8b5209124d28) has no exports 00010000:00010000:2.0:1787786479.523173:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787786479.523193:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6c00/0x450132973bff20df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x450132973bff20e6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786479.523203:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb6c00 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:2.0:1787786479.523207:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6c00/0x450132973bff20df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x450132973bff20e6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786479.523216:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6c00/0x450132973bff20df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x450132973bff20e6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787786479.523222:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6c00/0x450132973bff20df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x450132973bff20e6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787786479.523228:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787786479.523240:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1787786479.523243:0:5835:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1787786479.523259:0:5835:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8b5212c49000 00010000:00010000:2.0:1787786479.523263:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6c00/0x450132973bff20df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x450132973bff20e6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786479.523270:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6c00/0x450132973bff20df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x450132973bff20e6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786479.523282:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787786479.523286:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b5201677a00/0x450132973bff2324 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x450132973bff232b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786479.523291:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5201677a00 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:2.0:1787786479.523294:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b5201677a00/0x450132973bff2324 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x450132973bff232b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786479.523301:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b5201677a00/0x450132973bff2324 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x450132973bff232b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787786479.523308:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b5201677a00/0x450132973bff2324 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x450132973bff232b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787786479.523313:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1787786479.523315:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1787786479.523316:0:5835:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1787786479.523321:0:5835:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8b5212c49000 00010000:00010000:2.0:1787786479.523323:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b5201677a00/0x450132973bff2324 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x450132973bff232b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786479.523329:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b5201677a00/0x450132973bff2324 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x450132973bff232b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786479.523348:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786479.523349:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786479.523352:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786479.525646:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787786479.527583:0:13285:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8b5207a1e8a0 - data ffff8b5237e6cd80/ffff8b5233361800 00000020:01000000:3.0:1787786479.528319:0:13285:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8b52072baf00 - data ffff8b522d74b5e8/ffff8b5233360000 00100000:10000000:3.0:1787786479.542596:0:13285:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787786479.575196:0:13285:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff1fd5 00000020:00000080:0.0:1787786479.575207:0:13285:0:(genops.c:885:class_export_put()) final put ffff8b5206365800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1787786479.575225:0:13285:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8b5213768000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1787786479.575229:0:13285:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b5213768000 2 00000020:01000004:0.0:1787786479.575232:0:13285:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8b5213768000 from lustre-OST0001 00000020:00000080:0.0:1787786479.575253:0:13285:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787786479.575263:0:13285:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1787786479.575266:0:13285:0:(genops.c:885:class_export_put()) final put ffff8b5206367000/lustre-OST0001_UUID 00000020:00000080:0.0:1787786479.575268:0:13285:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5206367000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1787786479.575274:0:13285:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1787786479.575400:0:13285:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import a44a06f2-32e6-4870-9ef4-9f12b11e8ae1->MGS 00010000:00010000:0.0:1787786479.575416:0:13285:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b520151be00/0x450132973bff1ee7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x450132973bff1eee expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787786479.575428:0:13285:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b520151be00/0x450132973bff1ee7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x450132973bff1eee expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787786479.575434:0:13285:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1787786479.575437:0:13285:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1787786479.575441:0:13285:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1787786479.575457:0:13285:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8b5212c49000 00010000:00010000:0.0:1787786479.575461:0:13285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b520151be00/0x450132973bff1ee7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x450132973bff1eee expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786479.575475:0:13285:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6000/0x450132973bff2125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x450132973bff212c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787786479.575482:0:13285:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6000/0x450132973bff2125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x450132973bff212c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787786479.575487:0:13285:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787786479.575489:0:13285:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1787786479.575491:0:13285:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1787786479.575502:0:13285:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8b5212c49000 00010000:00010000:0.0:1787786479.575504:0:13285:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6000/0x450132973bff2125 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x450132973bff212c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787786479.575520:0:13285:0:(import.c:65:import_set_state_nolock()) ffff8b5212c49000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1787786479.575526:0:13285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787786479.575528:0:13285:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787786479.575529:0:13285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787786479.575534:0:13285:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787786479.575549:0:13285:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8b5103292d00 x1874629686806656/t0(0) o250->MGC192.168.204.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787786486 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787786479.575564:0:13285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787786479.575567:0:13285:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:3.0:1787786479.575646:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103292d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a44a06f2-32e6-4870-9ef4-9f12b11e8ae1:3310:1874629686806656:0@lo:250:ptlrpcd_00_02.0 00000020:00000080:2.0:1787786479.575719:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5206365800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:0.0:1787786479.575762:0:13285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787786479.575769:0:13285:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff1dc8 00000020:00000080:0.0:1787786479.575775:0:13285:0:(genops.c:885:class_export_put()) final put ffff8b5212c4e000/a44a06f2-32e6-4870-9ef4-9f12b11e8ae1 00000020:01000000:0.0:1787786479.575844:0:13285:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.134@tcp (flags='') 00000020:00000080:0.0:1787786479.575849:0:13285:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787786479.575854:0:13285:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.134@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787786479.575857:0:13285:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8b52090acd28) has no exports 10000000:01000000:3.0:1787786479.575918:0:5843:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1787786479.576045:0:13285:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.134@tcp: client import never connected 00000100:00080000:0.0:1787786479.576048:0:13285:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1787786479.576050:0:13285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787786479.576052:0:13285:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1787786479.576053:0:13285:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787786479.576193:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5212c4e000/a44a06f2-32e6-4870-9ef4-9f12b11e8ae1 for MGC192.168.204.134@tcp 00000020:00000080:0.0:1787786479.576265:0:13285:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787786479.576271:0:13285:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.134@tcp (uuid a44a06f2-32e6-4870-9ef4-9f12b11e8ae1) 00000020:01000000:0.0:1787786479.576275:0:13285:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787786479.576278:0:13285:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787786479.576281:0:13285:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787786479.576286:0:13285:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8b523b44e800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787786479.576291:0:13285:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff8b5209110000) has exports, disconnecting them 00000020:00080000:0.0:1787786479.576295:0:13285:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8b523b44e800), last request at 1787786294 00000020:00000080:0.0:1787786479.576298:0:13285:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff1fff 00000020:00080000:0.0:1787786479.576308:0:13285:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8b523b44e800): rc 0 00000020:00000080:0.0:1787786479.576311:0:13285:0:(genops.c:885:class_export_put()) final put ffff8b523b44e800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787786479.577067:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b5212c49000 for MGC192.168.204.134@tcp 00000020:00000080:2.0:1787786479.577075:0:8:0:(genops.c:885:class_export_put()) final put ffff8b5212c4c000/a44a06f2-32e6-4870-9ef4-9f12b11e8ae1 00000020:00000080:2.0:1787786479.577078:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b5212c4c000/a44a06f2-32e6-4870-9ef4-9f12b11e8ae1 for MGC192.168.204.134@tcp 00000020:01000000:2.0:1787786479.577082:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.134@tcp (a44a06f2-32e6-4870-9ef4-9f12b11e8ae1) 00000020:00000080:2.0:1787786479.577305:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b523b44e800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787786479.588614:0:13285:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787786479.588623:0:13285:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787786479.588628:0:13285:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787786479.588635:0:13285:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787786479.588867:0:7633:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1787786479.589054:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1787786479.589192:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1787786479.589358:0:5830:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8b5208f4b400:5830] 1 exiting: rc = 0 00000100:00100000:3.0:1787786479.589415:0:5829:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8b5203d23a00:5829] 0 exiting: rc = 1 00000020:00000080:2.0:1787786479.589490:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8b523b44f000 for lustre-MDT0000-lwp-OST0001 00000100:00100000:1.0:1787786479.589573:0:7632:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8b5208fc1c00:7632] 2 exiting: rc = 0 00000100:00100000:0.0:1787786479.589904:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.590244:0:5832:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8b52072bce00:5832] 1 exiting: rc = 0 00000100:00100000:0.0:1787786479.590482:0:11675:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff8b523bb12800:11675] 4 exiting: rc = 0 00000100:00100000:3.0:1787786479.590581:0:8508:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8b523bc2b000:8508] 3 exiting: rc = 0 00000100:00100000:3.0:1787786479.590646:0:5831:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8b5208f4bc00:5831] 0 exiting: rc = 1 00000100:00100000:3.0:1787786479.590906:0:5833:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8b52234a8400:5833] 2 exiting: rc = 0 00000100:00100000:0.0:1787786479.591004:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591013:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591021:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591026:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591032:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591037:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591043:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591050:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591055:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591061:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591067:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591074:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591080:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591085:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591090:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591095:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591101:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591105:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591110:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591114:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591119:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591123:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591127:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591132:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591136:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591140:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591145:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591151:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591156:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591161:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591165:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591170:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591175:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591207:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591212:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591218:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591223:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591227:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591233:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591238:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591244:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591248:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591253:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591259:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591264:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591269:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591274:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591279:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591283:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591288:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591293:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591298:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591304:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591309:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591315:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591320:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591324:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591329:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591334:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591338:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591343:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591349:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591355:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.591363:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1787786479.592168:0:13285:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787786479.592177:0:13285:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1787786479.592196:0:13285:0:(genops.c:885:class_export_put()) final put ffff8b52329a3000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1787786479.592200:0:13285:0:(genops.c:844:class_export_destroy()) destroying export ffff8b52329a3000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1787786479.592215:0:13285:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1787786479.592255:0:13285:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b5213768000 1 00000020:00000080:0.0:1787786479.592261:0:13285:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x450132973bff1fa4 00000020:00000080:0.0:1787786479.592268:0:13285:0:(genops.c:885:class_export_put()) final put ffff8b51013a0000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1787786479.592316:0:13285:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1787786479.592322:0:13285:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787786479.592327:0:13285:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787786479.592330:0:13285:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8b5209113370) has no exports 00000020:00000080:2.0:1787786479.593073:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8b51013a0000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1787786479.606568:0:13285:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787786479.606584:0:13285:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1787786479.606590:0:13285:0:(genops.c:885:class_export_put()) final put ffff8b523a1e0000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1787786479.606595:0:13285:0:(genops.c:844:class_export_destroy()) destroying export ffff8b523a1e0000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1787786479.606602:0:13285:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1787786479.607592:0:13285:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8b52116e6800 00000020:01000000:3.0:1787786479.607616:0:13285:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1787786479.607620:0:13285:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787786479.607625:0:13285:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787786479.607628:0:13285:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8b52090a8000) has no exports 00000020:00000080:3.0:1787786479.607653:0:13285:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787786479.607660:0:13285:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1787786479.607663:0:13285:0:(genops.c:885:class_export_put()) final put ffff8b523277d800/OSS_uuid 00000020:00000080:3.0:1787786479.607675:0:13285:0:(genops.c:844:class_export_destroy()) destroying export ffff8b523277d800/OSS_uuid for OSS 00000020:01000000:3.0:1787786479.607680:0:13285:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1787786479.607771:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8b52089f2000:6700] 2 exiting: rc = 0 00000100:00100000:3.0:1787786479.607871:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8b5213474000:6699] 1 exiting: rc = 0 00000100:00100000:3.0:1787786479.607920:0:8126:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8b523bb11400:8126] 3 exiting: rc = 0 00000100:00080000:2.0:1787786479.608003:0:5842:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1787786479.608223:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8b52072b8000:6698] 0 exiting: rc = 1 00000100:00100000:1.0:1787786479.608277:0:12026:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff8b5221abfc00:12026] 4 exiting: rc = 0 00000100:00100000:3.0:1787786479.608435:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608451:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608461:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608468:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608473:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608478:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608483:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608488:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608493:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608499:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608506:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608511:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608515:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608520:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608525:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608529:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608534:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608539:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608545:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608552:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608557:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608564:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608570:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608576:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608580:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608585:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608590:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608595:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608599:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608604:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608609:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608613:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608618:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608623:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608628:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608632:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608645:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608650:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608655:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608660:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608676:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608683:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608687:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608692:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608698:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608703:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608708:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608712:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608717:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608721:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608725:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608730:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608742:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608748:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608753:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608759:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608764:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608768:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608773:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608779:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608784:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608818:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608825:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.608835:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.609694:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8b52089f2e00:6702] 1 exiting: rc = 0 00000100:00100000:0.0:1787786479.612629:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8b5205255400:6701] 0 exiting: rc = 1 00000100:00100000:2.0:1787786479.613038:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613046:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613052:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613057:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613063:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613068:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613073:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613079:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613085:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613094:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613099:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613105:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613110:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613130:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613134:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613140:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613145:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613150:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613155:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613161:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613168:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613173:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613192:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613198:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613203:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613208:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613213:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613218:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613223:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613227:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613231:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613236:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613241:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613246:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613250:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613256:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613262:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613266:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613271:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613276:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613282:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613287:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613292:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613297:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613303:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613308:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613313:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613318:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613332:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613337:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613343:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613349:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613355:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613360:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613365:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613371:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613377:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613382:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613388:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613393:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613399:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613404:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613410:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787786479.613415:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.615310:0:6705:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8b52089f2800:6705] 1 exiting: rc = 0 00000100:00100000:0.0:1787786479.615542:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8b52089f3800:6704] 0 exiting: rc = 1 00000100:00100000:0.0:1787786479.615707:0:6706:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8b523ba0b000:6706] 2 exiting: rc = 0 00000100:00100000:3.0:1787786479.615898:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.615905:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.615911:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.615917:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.615923:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.615928:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.615952:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.615958:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.615964:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.615969:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.615975:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.615980:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.615986:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.615991:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.615997:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616003:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616008:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616013:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616019:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616026:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616032:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616037:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616044:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616064:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616071:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616078:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616083:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616088:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616093:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616098:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616103:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616108:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616115:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616121:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616125:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616132:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616137:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616143:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616150:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616156:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616164:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616176:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616194:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616200:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616205:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616210:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616215:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616237:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616244:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616249:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616254:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616260:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616266:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616272:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616278:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616291:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616297:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616302:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616307:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616313:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616318:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616323:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616328:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.616333:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.623999:0:6708:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8b5208f2a000:6708] 1 exiting: rc = 0 00000100:00100000:0.0:1787786479.624357:0:6707:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8b52182a2800:6707] 0 exiting: rc = 1 00000100:00100000:3.0:1787786479.624469:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624476:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624500:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624505:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624510:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624515:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624520:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624525:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624530:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624534:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624539:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624556:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624562:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624567:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624572:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624577:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624583:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624589:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624595:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624601:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624606:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624612:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624618:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624624:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624630:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624635:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624639:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624645:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624651:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624662:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624737:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624743:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624749:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624755:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624761:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624766:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624771:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624776:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624782:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624843:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624850:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624857:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624862:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624867:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624872:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624877:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624894:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624900:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624907:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624914:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624919:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624927:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624935:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624941:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624946:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624951:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624956:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624960:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624965:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624970:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624975:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624980:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624985:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.624993:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787786479.626286:0:6709:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8b52072b9200:6709] 0 exiting: rc = 1 00000100:00100000:2.0:1787786479.626398:0:6710:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8b52072b8400:6710] 1 exiting: rc = 0 00000100:00100000:3.0:1787786479.626624:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.626632:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.626638:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.626643:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.626648:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.626654:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.626677:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.626684:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.626690:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.626696:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.626704:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.626710:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.626716:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.626722:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.626729:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.626736:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.626742:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.626759:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.626781:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.626950:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.626959:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.626964:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.626971:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.626977:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.626983:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.626993:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.626999:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627005:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627012:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627018:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627041:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627049:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627054:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627062:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627067:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627073:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627078:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627083:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627090:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627096:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627102:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627107:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627127:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627134:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627139:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627145:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627151:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627156:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627162:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627168:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627175:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627196:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627211:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627217:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627238:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627247:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627253:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627260:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627267:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627274:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627280:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627286:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627292:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787786479.627298:0:13285:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1787786479.638708:0:13285:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1787786497.295446:0:13902:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg434-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787786506.562094:0:14375:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787786506.562102:0:14375:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787786506.562218:0:14375:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8b51033ae000 00000020:01000004:3.0:1787786506.562234:0:14375:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787786506.562243:0:14375:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787786506.562259:0:14375:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8b52067919b8) 00000020:00000080:3.0:1787786506.562274:0:14375:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787786506.582046:0:14375:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787786506.584320:0:14375:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1787786506.584969:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 373: rc = 0 00100000:10000000:2.0:1787786506.585159:0:14375:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787786506.585219:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 373: rc = 0 00100000:10000000:2.0:1787786506.585432:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 373: rc = 0 00100000:10000000:2.0:1787786506.585518:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 373: rc = 0 00100000:10000000:2.0:1787786506.585614:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 373: rc = 0 00100000:10000000:2.0:1787786506.585882:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 373: rc = 0 00100000:10000000:2.0:1787786506.586139:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 375: rc = 0 00100000:10000000:2.0:1787786506.587641:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 511: rc = 0 00100000:10000000:2.0:1787786506.587907:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 511: rc = 0 00100000:10000000:2.0:1787786506.588298:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 647: rc = 0 00100000:10000000:2.0:1787786506.589181:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 647: rc = 0 00100000:10000000:2.0:1787786506.589517:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 647: rc = 0 00100000:10000000:2.0:1787786506.589914:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 647: rc = 0 00100000:10000000:2.0:1787786506.590442:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 647: rc = 0 00100000:10000000:2.0:1787786506.590927:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 647: rc = 0 00100000:10000000:2.0:1787786506.591194:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 647: rc = 0 00100000:10000000:2.0:1787786506.591533:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 647: rc = 0 00100000:10000000:2.0:1787786506.591968:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 647: rc = 0 00100000:10000000:2.0:1787786506.592207:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 647: rc = 0 00100000:10000000:2.0:1787786506.592520:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 647: rc = 0 00100000:10000000:2.0:1787786506.593005:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 647: rc = 0 00100000:10000000:2.0:1787786506.593515:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 779: rc = 0 00100000:10000000:2.0:1787786506.594165:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 779: rc = 0 00100000:10000000:2.0:1787786506.595972:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 779: rc = 0 00100000:10000000:2.0:1787786506.596278:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 779: rc = 0 00100000:10000000:2.0:1787786506.596624:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 779: rc = 0 00100000:10000000:2.0:1787786506.597472:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 779: rc = 0 00100000:10000000:2.0:1787786506.597831:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 779: rc = 0 00100000:10000000:2.0:1787786506.598094:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 779: rc = 0 00100000:10000000:2.0:1787786506.598351:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 779: rc = 0 00100000:10000000:2.0:1787786506.599703:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 779: rc = 0 00100000:10000000:2.0:1787786506.600105:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 779: rc = 0 00100000:10000000:2.0:1787786506.600573:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 779: rc = 0 00100000:10000000:3.0:1787786506.601461:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 779: rc = 0 00100000:10000000:3.0:1787786506.601900:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 779: rc = 0 00100000:10000000:3.0:1787786506.602146:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 779: rc = 0 00100000:10000000:3.0:1787786506.602595:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 779: rc = 0 00100000:10000000:3.0:1787786506.603107:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 779: rc = 0 00100000:10000000:3.0:1787786506.603524:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 779: rc = 0 00100000:10000000:3.0:1787786506.603926:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 779: rc = 0 00100000:10000000:3.0:1787786506.604171:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 779: rc = 0 00100000:10000000:3.0:1787786506.604590:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 779: rc = 0 00100000:10000000:3.0:1787786506.605043:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 779: rc = 0 00100000:10000000:3.0:1787786506.605534:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 779: rc = 0 00100000:10000000:3.0:1787786506.605870:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 779: rc = 0 00100000:10000000:3.0:1787786506.606117:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 779: rc = 0 00100000:10000000:3.0:1787786506.608092:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 779: rc = 0 00100000:10000000:3.0:1787786506.608895:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 779: rc = 0 00100000:10000000:3.0:1787786506.609170:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 779: rc = 0 00100000:10000000:3.0:1787786506.609625:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 779: rc = 0 00100000:10000000:3.0:1787786506.610498:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 779: rc = 0 00100000:10000000:3.0:1787786506.611023:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 779: rc = 0 00100000:10000000:3.0:1787786506.611486:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 779: rc = 0 00100000:10000000:3.0:1787786506.612039:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 99: rc = 0 00100000:10000000:3.0:1787786506.612993:0:14375:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1787786506.613160:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 643: rc = 0 00100000:10000000:3.0:1787786506.614070:0:14375:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1787786506.614152:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 643: rc = 0 00100000:10000000:3.0:1787786506.614535:0:14375:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1787786506.614606:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 643: rc = 0 00100000:10000000:3.0:1787786506.616060:0:14375:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1787786506.616144:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 768: rc = 0 00100000:10000000:3.0:1787786506.616470:0:14375:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1787786506.616534:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 768: rc = 0 00100000:10000000:3.0:1787786506.617041:0:14375:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1787786506.617122:0:14375:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 768: rc = 0 00000020:00000080:3.0:1787786506.618691:0:14375:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787786506.618702:0:14375:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787786506.618713:0:14375:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x450132973bff30c9 00000020:01000004:3.0:1787786506.618722:0:14375:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787786506.618726:0:14375:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787786506.619666:0:14375:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8b51033ae000 from MGS 00000020:01000004:3.0:1787786506.619672:0:14375:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787786506.619688:0:14375:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8b5206790000) 00000020:00000080:3.0:1787786506.619707:0:14375:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787786506.620455:0:14375:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b51033ae000 from MGS, refs=2 00080000:01000000:3.0:1787786506.620466:0:14375:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787786506.620473:0:14375:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x450132973bff30d7 00000100:00100000:3.0:1787786506.620599:0:14375:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787786506.620761:0:14375:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787786506.620767:0:14375:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1787786506.622420:0:14375:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1787786506.622432:0:14375:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787786506.624121:0:14375:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787786506.624676:0:14375:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787786506.624683:0:14375:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787786506.625348:0:14375:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787786506.625356:0:14375:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787786506.625969:0:14375:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787786506.625976:0:14375:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1787786506.626556:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786506.626560:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786506.626561:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786506.627462:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786506.627466:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786506.627468:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786506.628128:0:14375:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1787786506.634787:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1787786506.653120:0:14375:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1787786506.653143:0:14375:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787786506.653146:0:14375:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1787786506.654844:0:14384:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787786506.654943:0:14375:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787786506.655043:0:14375:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787786506.655596:0:14375:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787786506.655975:0:14375:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787786506.656157:0:14375:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787786506.656163:0:14375:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787786506.656951:0:14375:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787786506.656960:0:14375:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787786506.659967:0:14375:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787786506.659984:0:14375:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:3.0:1787786506.663917:0:14389:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1787786506.664009:0:14375:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787786506.664031:0:14375:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.134@tcp' 00000020:01000004:1.0:1787786506.664033:0:14375:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787786506.664061:0:14375:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.134@tcp (typ=mgc) 00000020:00000080:1.0:1787786506.664073:0:14375:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.134@tcp (ffff8b5209123370) 00000020:00000080:1.0:1787786506.664087:0:14375:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787786506.664158:0:14375:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b520cb0c000@MGC192.168.204.134@tcp: add connection 192.168.204.134@tcp at head 00010000:00010000:1.0:1787786506.664323:0:14375:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.134@tcp-0 is initialized 00000040:01000000:1.0:1787786506.664501:0:14375:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.134@tcp ctxt 1 is initialized 10000000:01000000:1.0:1787786506.665870:0:14390:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787786506.670604:0:14375:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.134@tcp (uuid 6f0fadc2-0f1f-457d-abaa-699e28e40aa1) 00000020:00000080:2.0:1787786506.673352:0:14375:0:(genops.c:1385:class_connect()) connect: client 6f0fadc2-0f1f-457d-abaa-699e28e40aa1, cookie 0x450132973bff30e5 00000100:00080000:2.0:1787786506.673367:0:14375:0:(import.c:510:import_select_connection()) MGC192.168.204.134@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787786506.673373:0:14375:0:(import.c:624:import_select_connection()) MGC192.168.204.134@tcp: import ffff8b520cb0c000 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:2.0:1787786506.673418:0:14375:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b523333b480 x1874629686806912/t0(0) o250->MGC192.168.204.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787786506.673488:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523333b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3310:1874629686806912:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787786506.673560:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786506.673654:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686806912 00000100:00100000:0.0:1787786506.673671:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686806912 00000100:00100000:0.0:1787786506.673713:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787786506.673721:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523289d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3310:x1874629686806912:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1787786506.673757:0:14385:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 6f0fadc2-0f1f-457d-abaa-699e28e40aa1@0@lo t0 exp 0000000000000000 cur 433 last 0 00000020:00000080:0.0:1787786506.673781:0:14385:0:(genops.c:1385:class_connect()) connect: client 6f0fadc2-0f1f-457d-abaa-699e28e40aa1, cookie 0x450132973bff30ec 00000100:00080000:0.0:1787786506.673933:0:14385:0:(import.c:65:import_set_state_nolock()) ffff8b5237bbe800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1787786506.674284:0:14375:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 6f0fadc2-0f1f-457d-abaa-699e28e40aa1->MGS 00000020:01000004:2.0:1787786506.674311:0:14375:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1787786506.674316:0:14375:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1787786506.674330:0:14375:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8b5237ba3370) 00000020:00000080:2.0:1787786506.674341:0:14375:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787786506.677183:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523289d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+5:3310:x1874629686806912:12345-0@lo:250:mount.lustre.0 Request processed in 3451us (3612us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786506.677198:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787786506.678064:0:3310:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.134@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1787786506.678077:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.134@tcp: connect to target with instance 0 00000100:00080000:3.0:1787786506.678085:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.134@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1787786506.678090:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1787786506.678094:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b520cb0c000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1787786506.678097:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1787786506.678108:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1787786506.678114:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523333b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3310:1874629686806912:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1787786506.688692:0:14375:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787786506.689045:0:14375:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1787786506.689051:0:14375:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787786506.689920:0:14375:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787786506.689930:0:14375:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1787786506.694463:0:14375:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1787786506.694478:0:14375:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1787786506.699616:0:14375:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787786506.699889:0:14375:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1787786506.699896:0:14375:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1787786506.700445:0:14375:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1787786506.700455:0:14375:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787786506.762593:0:14375:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787786506.762928:0:14375:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787786506.762947:0:14375:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787786506.764288:0:14375:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787786506.764304:0:14375:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1787786506.765064:0:14375:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787786506.765243:0:14375:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787786506.765249:0:14375:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1787786506.765999:0:14375:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787786506.766006:0:14375:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1787786506.766642:0:14375:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787786506.766992:0:14375:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787786506.766998:0:14375:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1787786506.767596:0:14375:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787786506.767604:0:14375:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1787786506.768320:0:14375:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787786506.768490:0:14375:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1787786506.768496:0:14375:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787786506.769267:0:14375:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787786506.769275:0:14375:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787786506.794948:0:14375:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787786506.797892:0:14375:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787786506.797907:0:14375:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1787786506.799291:0:14375:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787786506.799303:0:14375:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787786506.802220:0:14375:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787786506.802234:0:14375:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787786506.806300:0:14375:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787786506.806557:0:14375:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787786506.806564:0:14375:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.134@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787786506.806728:0:14375:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.134@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787786506.806773:0:14375:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.134@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1787786506.806778:0:14375:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787786506.806779:0:14375:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787786506.806780:0:14375:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787786506.806782:0:14375:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787786506.806783:0:14375:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787786506.806784:0:14375:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787786506.806785:0:14375:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787786506.806787:0:14375:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787786506.806930:0:14375:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787786506.806933:0:14375:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787786506.806937:0:14375:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1787786506.806939:0:14375:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787786506.806940:0:14375:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787786506.806947:0:14375:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787786506.806949:0:14375:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787786506.806949:0:14375:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787786506.806951:0:14375:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787786506.806952:0:14375:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787786506.806953:0:14375:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787786506.806953:0:14375:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787786506.806954:0:14375:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787786506.806981:0:14375:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787786506.807000:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14375:1874629686807040:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787786506.807131:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786506.807216:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5232add540 going to sleep for 11 seconds 00000100:00100000:3.0:1787786506.807298:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686807040 00000100:00100000:3.0:1787786506.807306:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686807040 00000100:00100000:3.0:1787786506.807385:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787786506.807395:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523289d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+5:14375:x1874629686807040:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787786506.807457:0:14388:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787786506.807460:0:14388:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787786506.807464:0:14388:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1787786506.807813:0:14409:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1787786506.808158:0:14388:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1787786506.812164:0:14410:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1787786506.812172:0:14410:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1787786506.812175:0:14410:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1787786506.812206:0:14410:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1787786506.816209:0:14388:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787786506.816223:0:14388:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787786506.837487:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523289d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+5:14375:x1874629686807040:12345-0@lo:253:mount.lustre.0 Request processed in 30083us (30345us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786506.837502:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787786506.838925:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14375:1874629686807040:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787786506.838945:0:14375:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787786506.838948:0:14375:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787786506.838950:0:14375:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787786506.838952:0:14375:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787786506.838953:0:14375:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787786506.838955:0:14375:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787786506.838956:0:14375:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787786506.838958:0:14375:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787786506.838959:0:14375:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787786506.838961:0:14375:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787786506.838963:0:14375:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787786506.839012:0:14375:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8b51033ae000 from lustre-MDT0000 10000000:01000000:1.0:1787786506.839039:0:14375:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787786506.839042:0:14375:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787786506.839046:0:14375:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8b5209123370 10000000:01000000:1.0:1787786506.839051:0:14375:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787786506.839060:0:14375:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8b5209123370 from 1 10000000:01000000:1.0:1787786506.839063:0:14375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787786506.839104:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523b4d9400/0x450132973bff30fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786506.839115:0:14375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b523b4d9400/0x450132973bff30fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786506.839205:0:14375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b523b4d9400/0x450132973bff30fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786506.839227:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14375:1874629686807168:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787786506.839286:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786506.839416:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5232addc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787786506.839472:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686807168 00000100:00100000:2.0:1787786506.839479:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686807168 00000100:00100000:2.0:1787786506.839754:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787786506.839765:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523289c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+5:14375:x1874629686807168:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787786506.839778:0:14385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786506.839822:0:14385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5237aacc00/0x450132973bff3101 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff30fa expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786506.839862:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5237aacc00/0x450132973bff3101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff30fa expref: 6 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786506.839873:0:14385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5237aacc00/0x450132973bff3101 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff30fa expref: 6 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786506.839882:0:14385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aacc00, rc 0) 00000100:00100000:2.0:1787786506.839935:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523289c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+6:14375:x1874629686807168:12345-0@lo:101:mount.lustre.0 Request processed in 172us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786506.839943:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787786506.840026:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c0a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14375:1874629686807168:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787786506.840039:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b523b4d9400/0x450132973bff30fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff3101 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786506.840047:0:14375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b523b4d9400/0x450132973bff30fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff3101 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786506.840097:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14375:1874629686807296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787786506.840128:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786506.845872:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52134040c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787786506.849077:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686807296 00000100:00100000:1.0:1787786506.849096:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686807296 00000100:00100000:1.0:1787786506.849175:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787786506.849187:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523289c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+6:14375:x1874629686807296:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787786506.849522:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523289c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+6:14375:x1874629686807296:12345-0@lo:501:mount.lustre.0 Request processed in 337us (9392us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787786506.849531:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787786506.850588:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14375:1874629686807296:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787786506.850627:0:14375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787786506.861773:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523b4d9400/0x450132973bff30fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff3101 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786506.861807:0:14375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b523b4d9400/0x450132973bff30fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff3101 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786506.861818:0:14375:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8b51033ae000 10000000:01000000:3.0:1787786506.861829:0:14375:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787786506.861836:0:14375:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8b51033ae000 10000000:01000000:3.0:1787786506.861841:0:14375:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787786506.861844:0:14375:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8b51033ae000 from 1 10000000:01000000:3.0:1787786506.861848:0:14375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787786506.861891:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b52421d4c00/0x450132973bff3108 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786506.861900:0:14375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b52421d4c00/0x450132973bff3108 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786506.861911:0:14375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b52421d4c00/0x450132973bff3108 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786506.861937:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14375:1874629686807424:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787786506.862018:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786506.862075:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52134040c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787786506.862181:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686807424 00000100:00100000:2.0:1787786506.862189:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686807424 00000100:00100000:2.0:1787786506.862249:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787786506.862260:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523289ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+6:14375:x1874629686807424:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787786506.862277:0:14386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786506.862293:0:14386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5237aade00/0x450132973bff310f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff3108 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786506.862321:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5237aade00/0x450132973bff310f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff3108 expref: 7 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786506.862332:0:14386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5237aade00/0x450132973bff310f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff3108 expref: 7 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786506.862341:0:14386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aade00, rc 0) 00000100:00100000:2.0:1787786506.862385:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523289ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+7:14375:x1874629686807424:12345-0@lo:101:mount.lustre.0 Request processed in 126us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786506.862392:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787786506.863862:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14375:1874629686807424:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787786506.863887:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b52421d4c00/0x450132973bff3108 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff310f expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786506.863914:0:14375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b52421d4c00/0x450132973bff3108 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff310f expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787786506.863934:0:14375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1787786506.863957:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b52421d4c00/0x450132973bff3108 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff310f expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786506.863965:0:14375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b52421d4c00/0x450132973bff3108 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff310f expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787786506.863973:0:14375:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1787786506.863981:0:14375:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787786506.863987:0:14375:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8b51033ae000 10000000:01000000:0.0:1787786506.863990:0:14375:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1787786506.863994:0:14375:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1787786506.863997:0:14375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1787786506.864024:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520912cc00/0x450132973bff3116 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786506.864031:0:14375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b520912cc00/0x450132973bff3116 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786506.864039:0:14375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b520912cc00/0x450132973bff3116 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786506.864061:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b51032903c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14375:1874629686807552:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787786506.864118:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786506.864757:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5208689f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787786506.873163:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686807552 00000100:00100000:3.0:1787786506.873179:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686807552 00000100:00100000:3.0:1787786506.873380:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787786506.873392:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523289e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+7:14375:x1874629686807552:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787786506.873410:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786506.873450:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b52421d4e00/0x450132973bff311d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff3116 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786506.873503:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b52421d4e00/0x450132973bff311d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff3116 expref: 8 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786506.873516:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b52421d4e00/0x450132973bff311d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff3116 expref: 8 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786506.873526:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d4e00, rc 0) 00000100:00100000:3.0:1787786506.875012:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523289e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+8:14375:x1874629686807552:12345-0@lo:101:mount.lustre.0 Request processed in 1614us (10884us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786506.875024:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787786506.875164:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b51032903c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14375:1874629686807552:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787786506.875186:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b520912cc00/0x450132973bff3116 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff311d expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786506.875198:0:14375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b520912cc00/0x450132973bff3116 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff311d expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786506.875275:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b51032903c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14375:1874629686807680:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787786506.875312:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786506.887128:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5208689f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787786506.894946:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686807680 00000100:00100000:2.0:1787786506.894962:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686807680 00000100:00100000:2.0:1787786506.895034:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787786506.895046:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523289f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+8:14375:x1874629686807680:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787786506.895517:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523289f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+9:14375:x1874629686807680:12345-0@lo:501:mount.lustre.0 Request processed in 473us (20203us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786506.895525:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787786506.902256:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b51032903c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14375:1874629686807680:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787786506.902333:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b51032903c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14375:1874629686807808:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787786506.902423:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786506.902474:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5208689f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787786506.902639:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686807808 00000100:00100000:2.0:1787786506.902647:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686807808 00000100:00100000:2.0:1787786506.902713:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787786506.902722:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523289c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+9:14375:x1874629686807808:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787786506.903172:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523289c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+9:14375:x1874629686807808:12345-0@lo:503:mount.lustre.0 Request processed in 450us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786506.903180:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787786506.904213:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b51032903c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14375:1874629686807808:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787786506.904760:0:14411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b51032903c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14411:1874629686807936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787786506.905016:0:14411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786506.905061:0:14411:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5208689240 going to sleep for 11 seconds 00000100:00100000:1.0:1787786506.905130:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686807936 00000100:00100000:1.0:1787786506.905137:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686807936 00000100:00100000:1.0:1787786506.905189:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787786506.905199:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523289f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+9:14411:x1874629686807936:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787786506.905502:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523289f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+9:14411:x1874629686807936:12345-0@lo:502:llog_process_th.0 Request processed in 303us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786506.905509:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787786506.906268:0:14411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b51032903c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14411:1874629686807936:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787786506.906303:0:14411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787786506.906315:0:14411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787786506.906318:0:14411:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787786506.906324:0:14411:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787786506.906327:0:14411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787786506.906342:0:14411:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8b5209110000) 00000020:00000080:0.0:1787786506.906360:0:14411:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787786506.906376:0:14411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787786506.906438:0:14411:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787786506.906445:0:14411:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x450132973bff312b 00000020:00000080:0.0:1787786506.906768:0:14411:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787786506.906773:0:14411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787786506.906776:0:14411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787786506.906778:0:14411:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787786506.906780:0:14411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787786506.906784:0:14411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787786506.906785:0:14411:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787786506.906837:0:14411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787786506.906860:0:14411:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8b52091119b8) 00000020:00000080:0.0:1787786506.906870:0:14411:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787786506.906875:0:14411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787786506.906877:0:14411:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787786506.906879:0:14411:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787786506.906885:0:14411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787786506.906924:0:14411:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b51033ae000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787786506.906937:0:14411:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8b5209113370) 00000020:00000080:0.0:1787786506.906944:0:14411:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787786506.906992:0:14411:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787786506.906997:0:14411:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x450132973bff3140 00000020:00000080:0.0:1787786506.907078:0:14411:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787786506.907084:0:14411:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787786506.907089:0:14411:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x450132973bff3147 00080000:01000000:0.0:1787786506.907094:0:14411:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787786506.907097:0:14411:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x450132973bff314e 00010000:00010000:3.0:1787786507.023710:0:14411:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787786507.024482:0:14411:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1787786507.025225:0:14411:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787786507.026722:0:14411:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8b5206794d28) 00000020:00000080:3.0:1787786507.026923:0:14411:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1787786507.027016:0:14411:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:3.0:1787786507.027023:0:14411:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x450132973bff315c 00000020:00000080:2.0:1787786507.032017:0:14411:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787786507.050561:0:14411:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x450132973bff3163 00000020:00000080:1.0:1787786507.057463:0:14411:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787786507.057478:0:14411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787786507.057485:0:14411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787786507.057487:0:14411:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787786507.057492:0:14411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787786507.057511:0:14411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787786507.057512:0:14411:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787786507.057517:0:14411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787786507.057748:0:14411:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787786507.057769:0:14411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787786507.057773:0:14411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787786507.057774:0:14411:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787786507.057777:0:14411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787786507.057779:0:14411:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1787786507.057780:0:14411:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787786507.057782:0:14411:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787786507.057784:0:14411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787786507.057786:0:14411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787786507.057934:0:14411:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787786507.057941:0:14411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787786507.057945:0:14411:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787786507.057950:0:14411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787786507.057951:0:14411:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787786507.057955:0:14411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787786507.057961:0:14411:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.134@tcp to nid 0x20000c0a8cc86 (192.168.204.134@tcp) 00000020:01000000:1.0:1787786507.057990:0:14411:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787786507.057994:0:14411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787786507.058011:0:14411:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8b5209124d28) 00000020:00000080:1.0:1787786507.058028:0:14411:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1787786507.058033:0:14411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787786507.058092:0:14411:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787786507.058098:0:14411:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787786507.058103:0:14411:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x450132973bff3171 00010000:00080000:1.0:1787786507.058133:0:14411:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b523d2c4800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.134@tcp at head 00010000:00010000:1.0:1787786507.058357:0:14411:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1787786507.059297:0:14411:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787786507.059347:0:14411:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787786507.063414:0:14411:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787786507.067510:0:14411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1787786507.068636:0:14411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1787786507.076289:0:14415:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787786507.076298:0:14415:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787786507.077103:0:14411:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787786507.077117:0:14411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787786507.077150:0:14411:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787786507.077169:0:14411:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x450132973bff3178 00000100:00080000:3.0:1787786507.077181:0:14411:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787786507.077188:0:14411:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8b523d2c4800 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:3.0:1787786507.077228:0:14411:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b523b4d61c0 x1874629686808064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787786507.077319:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874629686808064:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787786507.077377:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874629686808064 offset 0 length 520: 4 00000100:00080000:3.0:1787786507.077453:0:14411:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787786507.077506:0:14411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787786507.077519:0:14411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787786507.077522:0:14411:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787786507.077525:0:14411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1787786507.077528:0:14411:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1787786507.077530:0:14411:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787786507.077531:0:14411:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1787786507.077533:0:14411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1787786507.077536:0:14411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787786507.077537:0:14411:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1787786507.077539:0:14411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787786507.077544:0:14411:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1787786507.077546:0:14411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787786507.077548:0:14411:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1787786507.077551:0:14411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1787786507.077555:0:14411:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.134@tcp to nid 0x20000c0a8cc86 (192.168.204.134@tcp) 00000020:01000000:3.0:1787786507.077576:0:14411:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1787786507.077579:0:14411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787786507.077590:0:14411:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8b5206793370) 00000020:00000080:3.0:1787786507.077600:0:14411:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1787786507.077604:0:14411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1787786507.077669:0:14411:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1787786507.077676:0:14411:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:3.0:1787786507.077681:0:14411:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x450132973bff3186 00010000:00080000:3.0:1787786507.077709:0:14411:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b52117ba000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.134@tcp at head 00010000:00010000:3.0:1787786507.077932:0:14411:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1787786507.078119:0:14411:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1787786507.078142:0:14411:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1787786507.078906:0:14411:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787786507.078988:0:14411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1787786507.079071:0:14411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1787786507.089385:0:14417:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787786507.089392:0:14417:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787786507.090704:0:14411:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787786507.090717:0:14411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787786507.090755:0:14411:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787786507.090774:0:14411:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x450132973bff318d 00000100:00080000:1.0:1787786507.090785:0:14411:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787786507.090826:0:14411:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8b52117ba000 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:1.0:1787786507.090864:0:14411:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5237c0b480 x1874629686808192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787786507.090892:0:14411:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787786507.090950:0:14411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787786507.090954:0:14411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787786507.090956:0:14411:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787786507.090959:0:14411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787786507.090963:0:14411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787786507.090965:0:14411:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787786507.090967:0:14411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787786507.090969:0:14411:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787786507.090971:0:14411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787786507.090974:0:14411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787786507.090975:0:14411:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787786507.090977:0:14411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787786507.090979:0:14411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787786507.090980:0:14411:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787786507.090983:0:14411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787786507.091017:0:14411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c0b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14411:1874629686808320:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787786507.091101:0:14411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786507.091144:0:14411:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b4e2900 going to sleep for 11 seconds 00000100:00100000:3.0:1787786507.091340:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686808320 00000100:00100000:3.0:1787786507.091347:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686808320 00000100:00100000:3.0:1787786507.091393:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787786507.091407:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523289fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+9:14411:x1874629686808320:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787786507.091632:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523289fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+9:14411:x1874629686808320:12345-0@lo:502:llog_process_th.0 Request processed in 225us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786507.091640:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787786507.091747:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874629686808192:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787786507.091779:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874629686808192 offset 0 length 520: 4 00000100:00100000:1.0:1787786507.092058:0:14411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c0b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14411:1874629686808320:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787786507.092084:0:14411:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787786507.092089:0:14411:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787786507.092091:0:14411:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787786507.092095:0:14411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1787786507.092283:0:14375:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1787786507.092302:0:14375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787786507.092322:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520912cc00/0x450132973bff3116 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff311d expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786507.092333:0:14375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b520912cc00/0x450132973bff3116 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff311d expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786507.092342:0:14375:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8b51033ae000 from 1 10000000:01000000:3.0:1787786507.092344:0:14375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787786507.092367:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff3194 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786507.092375:0:14375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff3194 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786507.092384:0:14375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff3194 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786507.092398:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14375:1874629686808448:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787786507.092426:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786507.092452:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5213404180 going to sleep for 11 seconds 00000100:00100000:0.0:1787786507.092501:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686808448 00000100:00100000:0.0:1787786507.092506:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686808448 00000100:00100000:0.0:1787786507.092535:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787786507.092542:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b43f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+9:14375:x1874629686808448:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787786507.092550:0:14386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786507.092574:0:14386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b520912ce00/0x450132973bff319b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff3194 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786507.092595:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b520912ce00/0x450132973bff319b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff3194 expref: 10 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786507.092606:0:14386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b520912ce00/0x450132973bff319b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff3194 expref: 10 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786507.092614:0:14386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912ce00, rc 0) 00000100:00100000:0.0:1787786507.092642:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b43f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+10:14375:x1874629686808448:12345-0@lo:101:mount.lustre.0 Request processed in 100us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786507.092658:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787786507.092779:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14375:1874629686808448:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787786507.092824:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff3194 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff319b expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786507.092844:0:14375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff3194 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff319b expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786507.093309:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14375:1874629686808576:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787786507.093341:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786507.093364:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5213404180 going to sleep for 11 seconds 00000100:00100000:0.0:1787786507.093533:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686808576 00000100:00100000:0.0:1787786507.093539:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686808576 00000100:00100000:0.0:1787786507.093577:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787786507.093586:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b43e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+10:14375:x1874629686808576:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1787786507.093602:0:14385:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1787786507.093608:0:14385:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1787786507.093699:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b43e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+10:14375:x1874629686808576:12345-0@lo:256:mount.lustre.0 Request processed in 114us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786507.093706:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787786507.094720:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14375:1874629686808576:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787786507.095443:0:14375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787786507.095539:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff3194 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff319b expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786507.095550:0:14375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff3194 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff319b expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786507.095559:0:14375:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b51033ae000 from 1 10000000:01000000:3.0:1787786507.095562:0:14375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787786507.095604:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff31a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786507.095611:0:14375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff31a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786507.095620:0:14375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff31a2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786507.095641:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14375:1874629686808704:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787786507.095710:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786507.095762:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5213404180 going to sleep for 11 seconds 00000100:00100000:0.0:1787786507.095929:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686808704 00000100:00100000:0.0:1787786507.095936:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686808704 00000100:00100000:0.0:1787786507.095982:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787786507.095991:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b43fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+10:14375:x1874629686808704:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787786507.096002:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786507.096014:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b520912d600/0x450132973bff31a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff31a2 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786507.096034:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b520912d600/0x450132973bff31a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff31a2 expref: 11 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786507.096045:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b520912d600/0x450132973bff31a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff31a2 expref: 11 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786507.096052:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912d600, rc 0) 00000100:00100000:0.0:1787786507.096094:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b43fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+11:14375:x1874629686808704:12345-0@lo:101:mount.lustre.0 Request processed in 104us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786507.096101:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787786507.096195:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14375:1874629686808704:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787786507.096208:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff31a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff31a9 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786507.096217:0:14375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff31a2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff31a9 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786507.096265:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14375:1874629686808832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787786507.096287:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786507.096310:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5213404180 going to sleep for 11 seconds 00000100:00100000:0.0:1787786507.097158:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686808832 00000100:00100000:0.0:1787786507.097168:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686808832 00000100:00100000:0.0:1787786507.097217:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787786507.097226:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b43c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+11:14375:x1874629686808832:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787786507.097676:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b43c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+11:14375:x1874629686808832:12345-0@lo:501:mount.lustre.0 Request processed in 449us (1386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786507.097685:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787786507.097781:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14375:1874629686808832:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787786507.097866:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5233338b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14375:1874629686808960:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787786507.097912:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786507.097934:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5206612900 going to sleep for 11 seconds 00000100:00100000:0.0:1787786507.098147:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686808960 00000100:00100000:0.0:1787786507.098153:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686808960 00000100:00100000:0.0:1787786507.098189:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787786507.098197:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b43dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+11:14375:x1874629686808960:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787786507.098337:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b43dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+11:14375:x1874629686808960:12345-0@lo:503:mount.lustre.0 Request processed in 141us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786507.098344:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787786507.099617:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5233338b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14375:1874629686808960:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787786507.100250:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d6580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14419:1874629686809088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787786507.100325:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786507.100365:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5213404540 going to sleep for 11 seconds 00000100:00100000:0.0:1787786507.100419:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686809088 00000100:00100000:0.0:1787786507.100425:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686809088 00000100:00100000:0.0:1787786507.100467:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787786507.100475:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b43d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+11:14419:x1874629686809088:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787786507.100730:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b43d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+11:14419:x1874629686809088:12345-0@lo:502:llog_process_th.0 Request processed in 255us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786507.100739:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787786507.100987:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d6580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14419:1874629686809088:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787786507.101013:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787786507.101022:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787786507.101024:0:14419:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787786507.101031:0:14419:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b51033ae000 00000020:00000080:3.0:1787786507.101034:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787786507.101043:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787786507.101045:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787786507.101047:0:14419:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787786507.101049:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787786507.101051:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787786507.101053:0:14419:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787786507.101057:0:14419:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b51033ae000 00000020:00000080:3.0:1787786507.101058:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787786507.101106:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787786507.101115:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787786507.101117:0:14419:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787786507.101120:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787786507.101123:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787786507.101124:0:14419:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787786507.101127:0:14419:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8b51033ae000 00000020:00000080:3.0:1787786507.101129:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787786507.101168:0:14419:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d6580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14419:1874629686809216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787786507.101203:0:14419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786507.101233:0:14419:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5213404540 going to sleep for 11 seconds 00000100:00100000:2.0:1787786507.101283:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686809216 00000100:00100000:2.0:1787786507.101288:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686809216 00000100:00100000:2.0:1787786507.101316:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787786507.101324:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b43ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+11:14419:x1874629686809216:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787786507.101478:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b43ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+11:14419:x1874629686809216:12345-0@lo:502:llog_process_th.0 Request processed in 154us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786507.101491:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787786507.101683:0:14419:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d6580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14419:1874629686809216:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787786507.101704:0:14419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787786507.101709:0:14419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787786507.101710:0:14419:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787786507.101713:0:14419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787786507.101935:0:14375:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787786507.101956:0:14375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787786507.111420:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff31a2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff31a9 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786507.111437:0:14375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff31a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff31a9 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787786507.111496:0:14375:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787786507.111499:0:14375:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8b51033ae000 10000000:01000000:2.0:1787786507.111502:0:14375:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8b51033ae000 10000000:01000000:2.0:1787786507.111506:0:14375:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787786507.111512:0:14375:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8b51033ae000 from 1 10000000:01000000:2.0:1787786507.111515:0:14375:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787786507.111625:0:14375:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b5237aac800/0x450132973bff31b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786507.111633:0:14375:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b5237aac800/0x450132973bff31b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786507.111645:0:14375:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b5237aac800/0x450132973bff31b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786507.111687:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5233338b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14375:1874629686809344:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787786507.111890:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786507.111935:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5206612600 going to sleep for 11 seconds 00000100:00100000:2.0:1787786507.112317:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686809344 00000100:00100000:2.0:1787786507.112324:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686809344 00000100:00100000:2.0:1787786507.112378:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787786507.112386:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b43d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+11:14375:x1874629686809344:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787786507.112399:0:14386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786507.112412:0:14386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5237aad400/0x450132973bff31b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff31b0 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786507.112435:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5237aad400/0x450132973bff31b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff31b0 expref: 12 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786507.112445:0:14386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5237aad400/0x450132973bff31b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff31b0 expref: 12 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786507.112453:0:14386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aad400, rc 0) 00000100:00100000:2.0:1787786507.112492:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b43d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+12:14375:x1874629686809344:12345-0@lo:101:mount.lustre.0 Request processed in 106us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786507.112498:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787786507.112625:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5233338b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14375:1874629686809344:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787786507.112640:0:14375:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b5237aac800/0x450132973bff31b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff31b7 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786507.112659:0:14375:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b5237aac800/0x450132973bff31b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff31b7 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786507.112865:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5233338b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14375:1874629686809472:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787786507.112894:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786507.112916:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5206612600 going to sleep for 11 seconds 00000100:00100000:1.0:1787786507.119021:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686809472 00000100:00100000:1.0:1787786507.119034:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686809472 00000100:00100000:1.0:1787786507.119128:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787786507.119138:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b43c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+12:14375:x1874629686809472:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787786507.119430:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b43c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+12:14375:x1874629686809472:12345-0@lo:501:mount.lustre.0 Request processed in 293us (6534us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786507.119438:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787786507.119532:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5233338b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14375:1874629686809472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787786507.119601:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b51032903c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14375:1874629686809600:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787786507.119642:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786507.124622:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b520781f780 going to sleep for 11 seconds 00000100:00100000:2.0:1787786507.124747:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686809600 00000100:00100000:2.0:1787786507.124757:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686809600 00000100:00100000:2.0:1787786507.132903:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787786507.132921:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b43c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+12:14375:x1874629686809600:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787786507.133186:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b43c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+12:14375:x1874629686809600:12345-0@lo:503:mount.lustre.0 Request processed in 271us (13542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786507.133195:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787786507.135060:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b51032903c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14375:1874629686809600:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787786507.140394:0:14424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c0b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14424:1874629686809728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787786507.140495:0:14424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786507.140544:0:14424:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b4e2540 going to sleep for 11 seconds 00000100:00100000:2.0:1787786507.140553:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686809728 00000100:00100000:2.0:1787786507.140562:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686809728 00000100:00100000:2.0:1787786507.140626:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787786507.140637:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b43f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+12:14424:x1874629686809728:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787786507.140948:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b43f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+12:14424:x1874629686809728:12345-0@lo:502:llog_process_th.0 Request processed in 313us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786507.140957:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787786507.141131:0:14424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c0b0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14424:1874629686809728:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1787786507.141208:0:14424:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787786507.141231:0:14424:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8b52091219b8) 00000020:00000080:1.0:1787786507.141251:0:14424:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1787786507.141335:0:14424:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b51033ae000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787786507.141340:0:14424:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8b51033ae000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787786507.141342:0:14424:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b51033ae000 4 00010000:00080000:1.0:1787786507.141370:0:14424:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b5237bbe000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.134@tcp at head 00010000:00010000:1.0:1787786507.143894:0:14424:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1787786507.144338:0:14424:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787786507.144380:0:14424:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787786507.144410:0:14424:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x450132973bff31c5 00000100:00080000:2.0:1787786507.144421:0:14424:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787786507.144427:0:14424:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8b5237bbe000 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:2.0:1787786507.144464:0:14424:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b523333ad00 x1874629686809856/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787786507.144491:0:14424:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787786507.146265:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523333ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874629686809856:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787786507.146356:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786507.147609:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686809856 00000100:00100000:2.0:1787786507.147620:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686809856 00000100:00100000:2.0:1787786507.147677:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787786507.147687:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b51032912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874629686809856:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787786507.147687:0:14394:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787786507.147702:0:14394:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787786507.147817:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b51032912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874629686809856:12345-0@lo:38:llog_process_th.0 Request processed in 101us (1431us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787786507.147825:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787786507.147854:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787786507.147864:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b5237bbe000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787786507.147869:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787786507.147874:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523333ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874629686809856:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787786507.148277:0:14424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523333a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14424:1874629686809984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787786507.148330:0:14424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786507.148355:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686809984 00000100:00100000:2.0:1787786507.148359:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686809984 00000100:00100000:2.0:1787786507.148388:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787786507.148394:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b43cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+12:14424:x1874629686809984:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787786507.149116:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b43cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+12:14424:x1874629686809984:12345-0@lo:502:llog_process_th.0 Request processed in 719us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786507.149125:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787786507.149180:0:14424:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5206612600 going to sleep for 11 seconds 00000100:00100000:2.0:1787786507.149200:0:14424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523333a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14424:1874629686809984:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787786507.149295:0:14424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787786507.151463:0:14375:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787786507.151507:0:14375:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787786507.151524:0:14375:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b5237aac800/0x450132973bff31b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff31b7 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786507.151536:0:14375:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b5237aac800/0x450132973bff31b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff31b7 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787786507.151666:0:14375:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787786507.151669:0:14375:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787786507.151670:0:14375:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787786507.151671:0:14375:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787786507.151672:0:14375:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787786507.151674:0:14375:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787786507.151675:0:14375:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787786507.151676:0:14375:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787786507.151678:0:14375:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787786507.151680:0:14375:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787786507.151684:0:14375:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1787786507.151686:0:14375:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787786507.151687:0:14375:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787786507.151689:0:14375:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787786507.151690:0:14375:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787786507.151691:0:14375:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787786507.151692:0:14375:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787786507.151693:0:14375:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787786507.151694:0:14375:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787786507.151695:0:14375:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787786507.151696:0:14375:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787786507.151722:0:14375:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787786507.151743:0:14375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c0b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14375:1874629686810112:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787786507.151909:0:14375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786507.151948:0:14375:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52073779c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787786507.155928:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686810112 00000100:00100000:2.0:1787786507.155943:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686810112 00000100:00100000:2.0:1787786507.156000:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787786507.156010:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b43f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+12:14375:x1874629686810112:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787786507.156042:0:14386:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787786507.156056:0:14386:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787786507.268815:0:14386:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787786507.268827:0:14386:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787786507.268930:0:14409:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787786507.268935:0:14409:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787786507.268956:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b5237aace00/0x450132973bff31cc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786507.268976:0:14409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b520912ce00/0x450132973bff319b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff3194 expref: 12 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786507.268985:0:14409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b5237aace00/0x450132973bff31cc lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786507.269036:0:14409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b520912ce00/0x450132973bff319b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff3194 expref: 12 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786507.269049:0:14409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b520912ce00/0x450132973bff319b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff3194 expref: 12 pid: 14386 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786507.269063:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523333a1c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14409:1874629686810240:0@lo:104: 00000100:00100000:2.0:1787786507.269125:0:14409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786507.269188:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52182aa780 going to sleep for 11 seconds 00000100:00100000:1.0:1787786507.269366:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686810240 00000100:00100000:1.0:1787786507.269373:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686810240 00000100:00100000:1.0:1787786507.269425:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787786507.269434:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523333a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+3:14409:x1874629686810240:12345-0@lo:104: 00010000:00010000:1.0:1787786507.269446:0:14376:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff3194 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff319b expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786507.269492:0:14376:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787786507.269497:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523333a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+3:14409:x1874629686810240:12345-0@lo:104: Request processed in 65us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786507.269504:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787786507.269523:0:14382:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787786507.269531:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff3194 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff319b expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786507.269538:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d4000 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:1.0:1787786507.269542:0:14382:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff3194 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff319b expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786507.269550:0:14382:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff3194 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff319b expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787786507.269557:0:14382:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff3194 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff319b expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787786507.269574:0:14382:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787786507.269599:0:14382:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff3194 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff319b expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786507.269606:0:14382:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787786507.269622:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff3194 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff319b expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786507.269638:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff3194 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff319b expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786507.269663:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786507.269665:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786507.269666:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786507.269692:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3311:1874629686810368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787786507.269718:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786507.269781:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686810368 00000100:00100000:1.0:1787786507.269784:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686810368 00010000:00010000:1.0:1787786507.269831:0:14378:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b520912ce00/0x450132973bff319b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff3194 expref: 13 pid: 14386 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786507.269848:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787786507.269854:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+13:3311:x1874629686810368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787786507.269863:0:14378:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786507.269867:0:14378:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b520912ce00/0x450132973bff319b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff3194 expref: 13 pid: 14386 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786507.269877:0:14378:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b520912ce00/0x450132973bff319b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff3194 expref: 13 pid: 14386 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786507.269892:0:14378:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b5237aace00/0x450132973bff31cc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786507.269900:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5237aace00/0x450132973bff31cc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787786507.269911:0:14378:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000977590s 00010000:00010000:1.0:1787786507.269920:0:14378:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b5237aace00/0x450132973bff31cc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786507.269927:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b5237aace00/0x450132973bff31cc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786507.269934:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b5237aace00/0x450132973bff31cc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786507.269941:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b5237aace00/0x450132973bff31cc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786507.269946:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aace00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:1.0:1787786507.269950:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b5237aace00/0x450132973bff31cc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786507.269957:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b5237aace00/0x450132973bff31cc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786507.269971:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b5237aace00/0x450132973bff31cc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786507.269980:0:14378:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786507.270004:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+13:3311:x1874629686810368:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786507.270010:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787786507.270049:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3311:1874629686810368:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787786507.270673:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b520912ce00/0x450132973bff319b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff3194 expref: 12 pid: 14386 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786507.270685:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523333a1c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14409:1874629686810240:0@lo:104: 00010000:00010000:2.0:1787786507.270698:0:14409:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b5237aace00/0x450132973bff31cc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786507.270706:0:14409:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b5237aace00/0x450132973bff31cc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786507.270711:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b5237aace00/0x450132973bff31cc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786507.270717:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5237aace00/0x450132973bff31cc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786507.324012:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b43f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+11:14375:x1874629686810112:12345-0@lo:253:mount.lustre.0 Request processed in 167993us (172092us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786507.324028:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787786507.324195:0:14375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c0b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14375:1874629686810112:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787786507.324214:0:14375:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787786507.324218:0:14375:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787786507.324226:0:14375:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787786507.324227:0:14375:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787786507.324229:0:14375:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787786507.324230:0:14375:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787786507.324232:0:14375:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787786507.324233:0:14375:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787786507.324235:0:14375:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787786507.324237:0:14375:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787786507.324239:0:14375:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787786507.324257:0:14375:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787786507.336188:0:14375:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1787786507.336356:0:14375:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787786507.336661:0:14375:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1787786507.336846:0:14375:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787786507.337119:0:14375:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1787786507.337283:0:14375:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787786507.342708:0:14375:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787786507.342924:0:14375:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787786507.343189:0:14375:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787786507.343378:0:14375:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787786507.343594:0:14375:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787786507.343736:0:14375:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1787786507.431297:0:14375:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1787786507.432250:0:14375:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1787786507.432609:0:14434:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1787786507.432697:0:14434:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787786507.436965:0:14434:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1787786507.437058:0:14434:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1787786507.437062:0:14434:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1787786507.438574:0:14375:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787786507.438716:0:14375:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1787786507.439184:0:14433:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1787786507.439189:0:14433:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000004:00000080:2.0:1787786507.440000:0:14375:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1787786507.440105:0:14375:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1787786507.440392:0:14375:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787786507.441694:0:14375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1787786507.442569:0:14375:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787786507.442615:0:14375:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1787786507.446377:0:14375:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1787786507.453279:0:14375:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1787786507.483534:0:14375:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1787786507.483574:0:14375:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb4ac01893988 00100000:10000000:3.0:1787786507.483582:0:14375:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1787786507.484306:0:14375:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787786507.484321:0:14375:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.134@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787786507.484335:0:14375:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787786507.484351:0:14375:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1787786507.665134:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787786507.850428:0:14390:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787786507.850439:0:14390:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8b51033ae000 from 6 10000000:01000000:2.0:1787786507.850443:0:14390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787786507.850486:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b5237aad200/0x450132973bff31d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786507.850497:0:14390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b5237aad200/0x450132973bff31d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786507.850509:0:14390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b5237aad200/0x450132973bff31d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786507.850534:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523333a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686810496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787786507.850603:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786507.850712:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5207b59c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787786507.850861:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686810496 00000100:00100000:3.0:1787786507.850869:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686810496 00000100:00100000:2.0:1787786507.851148:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787786507.851158:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b43e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+11:14390:x1874629686810496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787786507.851173:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786507.851187:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5237aac600/0x450132973bff31da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff31d3 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786507.851212:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5237aac600/0x450132973bff31da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff31d3 expref: 12 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786507.851235:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5237aac600/0x450132973bff31da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff31d3 expref: 12 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786507.851245:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aac600, rc 0) 00000100:00100000:2.0:1787786507.851340:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b43e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+12:14390:x1874629686810496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786507.851347:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787786507.851414:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523333a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686810496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787786507.851431:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b5237aad200/0x450132973bff31d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff31da expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786507.851439:0:14390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b5237aad200/0x450132973bff31d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff31da expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786507.851495:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686810624:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787786507.851529:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786507.851560:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5208839a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787786507.851716:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686810624 00000100:00100000:0.0:1787786507.851721:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686810624 00000100:00100000:0.0:1787786507.851757:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787786507.851765:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b43e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+12:14390:x1874629686810624:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787786507.851779:0:14386:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787786507.851826:0:14386:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787786507.851830:0:14386:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1787786507.851926:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b43e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+12:14390:x1874629686810624:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 160us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786507.851933:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787786507.851975:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686810624:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787786507.852022:0:14390:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787786507.852029:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b5237aad200/0x450132973bff31d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff31da expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786507.852039:0:14390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b5237aad200/0x450132973bff31d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff31da expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787786508.171903:0:14428:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787786508.681986:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787786509.195461:0:14428:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1787786509.709656:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786510.737189:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786511.761808:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787786512.393922:0:12641:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787786512.393929:0:12641:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787786512.393931:0:12641:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787786512.393934:0:12641:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787786512.393937:0:12641:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1787786512.393940:0:12641:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1787786512.393944:0:12641:0:(import.c:65:import_set_state_nolock()) ffff8b5237bbe000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787786512.393963:0:12641:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8b5237bbe000 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:2.0:1787786512.393987:0:12641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5233339680 x1874629686810880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787786512.394071:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787786512.394087:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523333a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3311:1874629686810752:0@lo:400:kworker.0 00000100:00100000:3.0:1787786512.394174:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786512.394255:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5233339680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874629686810880:0@lo:38:kworker.0 00000100:00100000:2.0:1787786512.394292:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786512.394341:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686810752 00000100:00100000:2.0:1787786512.394349:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686810752 00000100:00100000:2.0:1787786512.394397:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787786512.394406:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523baef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+12:3311:x1874629686810752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786512.394424:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686810880 00000100:00100000:3.0:1787786512.394428:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686810880 00000100:00100000:3.0:1787786512.394449:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787786512.394455:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523333bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1874629686810880:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1787786512.394456:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523baef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+12:3311:x1874629686810752:12345-0@lo:400:kworker.0 Request processed in 51us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786512.394462:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1787786512.394478:0:14395:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:3.0:1787786512.394513:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x450132973bff31e1 00000100:00100000:2.0:1787786512.394513:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523333a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3311:1874629686810752:0@lo:400:kworker.0 00000004:00100000:3.0:1787786512.394528:0:14395:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787786512.394673:0:14395:0:(import.c:65:import_set_state_nolock()) ffff8b5237c40000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787786512.394721:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523333bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874629686810880:12345-0@lo:38:kworker.0 Request processed in 264us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786512.394728:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787786512.394839:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8b5233339680 x1874629686810880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787786522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787786512.394853:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787786512.394861:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1787786512.394865:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787786512.395026:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b5237bbe000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787786512.395101:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5233339680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874629686810880:0@lo:38:kworker.0 00000001:02000400:1.0:1787786512.462204:0:14677:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg434-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787786512.780494:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786513.801989:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786514.826402:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786515.850342:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787786516.037125:0:14827:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeebf4d1d0 20000000:00000080:2.0:1787786516.037149:0:14827:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8b5234c6c800 uarg=0000000000000000 20000000:01000000:2.0:1787786516.037187:0:14827:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787786516.037202:0:14827:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787786516.037209:0:14827:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787786516.042888:0:14828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1787786516.043080:0:14827:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1787786516.054535:0:14827:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787786516.054571:0:14827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b5237aad600/0x450132973bff31e8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786516.054593:0:14827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b520912d600/0x450132973bff31a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff31a2 expref: 11 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786516.054603:0:14827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b5237aad600/0x450132973bff31e8 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786516.054649:0:14827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b520912d600/0x450132973bff31a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff31a2 expref: 11 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786516.054665:0:14827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b520912d600/0x450132973bff31a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff31a2 expref: 11 pid: 14388 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786516.054681:0:14827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5233338000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14827:1874629686811008:0@lo:104: 00000100:00100000:2.0:1787786516.054754:0:14827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786516.055112:0:14827:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5221b87180 going to sleep for 11 seconds 00000100:00100000:1.0:1787786516.058498:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686811008 00000100:00100000:1.0:1787786516.058515:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686811008 00000100:00100000:1.0:1787786516.058575:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787786516.058585:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523333b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+3:14827:x1874629686811008:12345-0@lo:104: 00010000:00010000:1.0:1787786516.058619:0:14377:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff31a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff31a9 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786516.058726:0:14377:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787786516.058732:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523333b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+3:14827:x1874629686811008:12345-0@lo:104: Request processed in 149us (3978us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786516.058741:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787786516.058755:0:14382:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787786516.058768:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff31a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff31a9 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786516.058776:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d4a00 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:3.0:1787786516.058780:0:14382:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff31a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff31a9 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786516.058819:0:14382:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff31a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff31a9 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787786516.058828:0:14382:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff31a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff31a9 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786516.058834:0:14382:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787786516.058878:0:14382:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff31a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff31a9 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786516.058880:0:14827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5233338000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14827:1874629686811008:0@lo:104: 00010000:00010000:3.0:1787786516.058885:0:14382:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787786516.058904:0:14827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b5237aad600/0x450132973bff31e8 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786516.058906:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff31a2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff31a9 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786516.058914:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff31a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff31a9 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786516.058930:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786516.058932:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786516.058934:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786516.058953:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787786516.058964:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3314:1874629686811136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787786516.059006:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786516.059027:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686811136 00000100:00100000:1.0:1787786516.059031:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686811136 00010000:00010000:1.0:1787786516.059048:0:14378:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b520912d600/0x450132973bff31a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff31a2 expref: 12 pid: 14388 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786516.059078:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787786516.059085:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+12:3314:x1874629686811136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787786516.059097:0:14378:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786516.059104:0:14378:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b520912d600/0x450132973bff31a9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff31a2 expref: 12 pid: 14388 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786516.059116:0:14378:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b520912d600/0x450132973bff31a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff31a2 expref: 12 pid: 14388 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786516.059129:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b520912d600/0x450132973bff31a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff31a2 expref: 12 pid: 14388 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786516.059145:0:14378:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b5237aad600/0x450132973bff31e8 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786516.059153:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5237aad600/0x450132973bff31e8 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786516.059178:0:14378:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b5237aad600/0x450132973bff31e8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786516.059185:0:14378:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b5237aad600/0x450132973bff31e8 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786516.059191:0:14378:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b5237aad600/0x450132973bff31e8 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786516.059197:0:14378:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b5237aad600/0x450132973bff31e8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786516.059203:0:14378:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aad600 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:1.0:1787786516.059207:0:14378:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b5237aad600/0x450132973bff31e8 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786516.059214:0:14378:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b5237aad600/0x450132973bff31e8 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786516.059233:0:14378:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b5237aad600/0x450132973bff31e8 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786516.059243:0:14378:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787786516.059252:0:14827:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b5237aad600/0x450132973bff31e8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786516.059265:0:14827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b5237aad600/0x450132973bff31e8 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786516.059272:0:14827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5237aad600/0x450132973bff31e8 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786516.059279:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+11:3314:x1874629686811136:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786516.059286:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787786516.059400:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3314:1874629686811136:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787786516.876212:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787786517.516108:0:12641:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787786517.516116:0:12641:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787786517.516119:0:12641:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787786517.516122:0:12641:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787786517.516156:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787786517.516175:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3313:1874629686811264:0@lo:400:kworker.0 00000100:00100000:0.0:1787786517.516250:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786517.516298:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787786517.516307:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b51032903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874629686811392:0@lo:400:kworker.0 00000100:00100000:0.0:1787786517.516336:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786517.516367:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686811264 00000100:00100000:0.0:1787786517.516374:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686811264 00000100:00100000:0.0:1787786517.516424:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787786517.516433:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523baee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+11:3313:x1874629686811264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786517.516492:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523baee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+11:3313:x1874629686811264:12345-0@lo:400:kworker.0 Request processed in 60us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786517.516499:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787786517.516530:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686811392 00000100:00100000:0.0:1787786517.516534:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686811392 00000100:00100000:0.0:1787786517.516564:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787786517.516570:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103292940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874629686811392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786517.516604:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103292940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874629686811392:12345-0@lo:400:kworker.0 Request processed in 34us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786517.516610:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787786517.516642:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8b51032903c0 x1874629686811392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787786533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786517.516657:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b51032903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874629686811392:0@lo:400:kworker.0 00000100:00100000:0.0:1787786517.516681:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3313:1874629686811264:0@lo:400:kworker.0 00000100:00100000:3.0:1787786517.517095:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787786507/real 1787786507] req@ffff8b5237c0b480 x1874629686808192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787786517 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786517.517113:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8b5237c0b480 x1874629686808192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787786517 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786517.517124:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787786507/real 1787786507] req@ffff8b523b4d61c0 x1874629686808064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787786517 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786517.517135:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8b523b4d61c0 x1874629686808064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787786517 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787786517.517148:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b52117ba000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787786517.517167:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787786517.517171:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874629686808192:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1787786517.517176:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b523d2c4800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787786517.517181:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1787786517.517184:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874629686808064:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1787786517.517339:0:12641:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787786517.517343:0:12641:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787786517.517346:0:12641:0:(import.c:65:import_set_state_nolock()) ffff8b523d2c4800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787786517.517350:0:12641:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 433 00000100:00080000:0.0:1787786517.517354:0:12641:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787786517.517359:0:12641:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8b523d2c4800 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:0.0:1787786517.517383:0:12641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5103290000 x1874629686811520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787786517.517407:0:12641:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787786517.517420:0:12641:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787786517.517422:0:12641:0:(import.c:65:import_set_state_nolock()) ffff8b52117ba000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787786517.517425:0:12641:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 433 00000100:00080000:0.0:1787786517.517428:0:12641:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1787786517.517432:0:12641:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8b52117ba000 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:0.0:1787786517.517444:0:12641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b51032903c0 x1874629686811648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787786517.517506:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874629686811520:0@lo:8:kworker.0 00000400:00000100:3.0:1787786517.517541:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874629686811520 offset 0 length 520: 4 00000100:00100000:3.0:1787786517.517576:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b51032903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874629686811648:0@lo:8:kworker.0 00000400:00000100:3.0:1787786517.517597:0:3310:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874629686811648 offset 0 length 520: 4 10000000:01000000:0.0:1787786517.897908:0:14390:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787786517.897916:0:14390:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b51033ae000 from 10 10000000:01000000:0.0:1787786517.897922:0:14390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787786517.898087:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff31ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786517.898099:0:14390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff31ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786517.898111:0:14390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff31ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786517.898140:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b51032921c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686811776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787786517.898212:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786517.898264:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5206e3ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1787786517.898357:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686811776 00000100:00100000:2.0:1787786517.898365:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686811776 00000100:00100000:2.0:1787786517.898414:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787786517.898424:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523baed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+11:14390:x1874629686811776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787786517.898466:0:14385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786517.898479:0:14385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5237aad800/0x450132973bff31f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff31ef expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786517.898503:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5237aad800/0x450132973bff31f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff31ef expref: 12 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786517.898514:0:14385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5237aad800/0x450132973bff31f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff31ef expref: 12 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786517.898523:0:14385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aad800, rc 0) 00000100:00100000:2.0:1787786517.898680:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523baed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+12:14390:x1874629686811776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 257us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786517.898687:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787786517.900654:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b51032921c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686811776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787786517.900682:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff31ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff31f6 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786517.900695:0:14390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff31ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff31f6 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786517.900768:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686811904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787786517.901604:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786517.901692:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5207b59b40 going to sleep for 11 seconds 00010000:00010000:3.0:1787786517.901735:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786517.904019:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686811904 00000100:00100000:2.0:1787786517.904032:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686811904 00000100:00100000:2.0:1787786517.904138:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787786517.904147:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523baefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+12:14390:x1874629686811904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787786517.904461:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523baefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+12:14390:x1874629686811904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 314us (3530us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786517.904469:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787786517.904565:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d61c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686811904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787786517.904625:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103290b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686812032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787786517.904675:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786517.910894:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686812032 00000100:00100000:3.0:1787786517.910910:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686812032 00000100:00100000:2.0:1787786517.913026:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5206e3c600 going to sleep for 11 seconds 00000100:00100000:0.0:1787786517.913719:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787786517.913730:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523baef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+12:14390:x1874629686812032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787786517.914031:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523baef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+12:14390:x1874629686812032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 302us (9354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786517.914039:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787786517.914203:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103290b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686812032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787786517.915219:0:14896:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787786517.915423:0:14390:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787786517.915451:0:14390:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787786517.915461:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff31ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff31f6 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786517.915473:0:14390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff31ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff31f6 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786518.926954:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787786519.434632:0:14428:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787786519.945936:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786520.970083:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787786521.452850:0:15076:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787786521.452855:0:15076:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1787786521.453037:0:15076:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8b52116e0000 00000020:01000004:0.0:1787786521.453054:0:15076:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787786521.453065:0:15076:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787786521.453156:0:15076:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8b5209114d28) 00000020:00000080:0.0:1787786521.453178:0:15076:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787786521.472727:0:15076:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787786521.473729:0:15076:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1787786521.474920:0:15076:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787786521.475270:0:15076:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1787786521.477910:0:15076:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1787786521.478298:0:15076:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 513: rc = 0 00100000:10000000:0.0:1787786521.478438:0:15076:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 513: rc = 0 00100000:10000000:2.0:1787786521.480586:0:15076:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 513: rc = 0 00100000:10000000:2.0:1787786521.481240:0:15076:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 775: rc = 0 00100000:10000000:2.0:1787786521.481544:0:15076:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 775: rc = 0 00100000:10000000:2.0:1787786521.481828:0:15076:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 775: rc = 0 00100000:10000000:2.0:1787786521.482103:0:15076:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 775: rc = 0 00100000:10000000:2.0:1787786521.482381:0:15076:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 775: rc = 0 00100000:10000000:2.0:1787786521.482629:0:15076:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 775: rc = 0 00000020:00000080:3.0:1787786521.491724:0:15076:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1787786521.491741:0:15076:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787786521.491755:0:15076:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x450132973bff3204 00000020:01000004:3.0:1787786521.491765:0:15076:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1787786521.491809:0:15076:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.134@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787786521.491813:0:15076:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787786521.491820:0:15076:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1787786521.491827:0:15076:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1787786521.491855:0:15076:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8b52090a8000) 00000020:00000080:3.0:1787786521.491951:0:15076:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1787786521.493553:0:15076:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787786521.493780:0:15076:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787786521.493786:0:15076:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787786521.498500:0:15076:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787786521.498515:0:15076:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1787786521.499420:0:15076:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1787786521.499431:0:15076:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1787786521.501364:0:15076:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787786521.501624:0:15076:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1787786521.501632:0:15076:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787786521.512352:0:15076:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787786521.512378:0:15076:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1787786521.558665:0:15076:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787786521.558992:0:15076:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787786521.558999:0:15076:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1787786521.561143:0:15076:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787786521.561164:0:15076:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1787786521.562425:0:15076:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787786521.562439:0:15076:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1787786521.565249:0:15076:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787786521.565631:0:15076:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1787786521.565639:0:15076:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787786521.566631:0:15076:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787786521.566641:0:15076:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1787786521.614677:0:15076:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787786521.615187:0:15076:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1787786521.615194:0:15076:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787786521.617707:0:15076:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787786521.617724:0:15076:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787786521.618714:0:15076:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787786521.618746:0:15076:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787786521.618753:0:15076:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.134@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1787786521.631733:0:15076:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.134@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787786521.631778:0:15076:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.134@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1787786521.631783:0:15076:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787786521.631784:0:15076:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787786521.631786:0:15076:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787786521.631946:0:15076:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787786521.631948:0:15076:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787786521.631950:0:15076:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787786521.631951:0:15076:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787786521.631953:0:15076:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787786521.631955:0:15076:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787786521.631958:0:15076:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1787786521.631961:0:15076:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787786521.631962:0:15076:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787786521.631963:0:15076:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787786521.631965:0:15076:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787786521.631966:0:15076:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787786521.631967:0:15076:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787786521.631968:0:15076:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787786521.631969:0:15076:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787786521.631970:0:15076:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787786521.631996:0:15076:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787786521.632016:0:15076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523333ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686812160:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787786521.632165:0:15076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786521.632283:0:15076:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b4bea80 going to sleep for 11 seconds 00000100:00100000:0.0:1787786521.632334:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686812160 00000100:00100000:0.0:1787786521.632407:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686812160 00000100:00100000:0.0:1787786521.632619:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787786521.632630:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523baec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+12:15076:x1874629686812160:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787786521.632674:0:14385:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1787786521.632678:0:14385:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1787786521.632682:0:14385:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1787786521.650908:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523baec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+12:15076:x1874629686812160:12345-0@lo:253:mount.lustre.0 Request processed in 18264us (18725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786521.650933:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787786521.651163:0:15076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523333ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686812160:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787786521.651184:0:15076:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787786521.651187:0:15076:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787786521.651189:0:15076:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787786521.651191:0:15076:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787786521.651192:0:15076:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787786521.651193:0:15076:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787786521.651195:0:15076:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787786521.651196:0:15076:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787786521.651199:0:15076:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787786521.651201:0:15076:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787786521.651243:0:15076:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8b52116e0000 from lustre-OST0000 10000000:01000000:2.0:1787786521.651276:0:15076:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787786521.651279:0:15076:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787786521.651288:0:15076:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8b5209123370 local copy 00010000:00010000:2.0:1787786521.651300:0:15076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523b4d9400/0x450132973bff30fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff3101 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786521.651714:0:15076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523333ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686812288:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787786521.651762:0:15076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786521.651893:0:15076:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b4be780 going to sleep for 11 seconds 00000100:00100000:1.0:1787786521.652041:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686812288 00000100:00100000:1.0:1787786521.652048:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686812288 00000100:00100000:0.0:1787786521.652282:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787786521.652293:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523baecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+12:15076:x1874629686812288:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787786521.652619:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523baecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+12:15076:x1874629686812288:12345-0@lo:501:mount.lustre.0 Request processed in 327us (855us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787786521.652630:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787786521.652731:0:15076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523333ad00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686812288:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787786521.652753:0:15076:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787786521.652981:0:15076:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787786521.652991:0:15076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523b4d9400/0x450132973bff30fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff3101 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786521.653002:0:15076:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b523b4d9400/0x450132973bff30fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff3101 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786521.653036:0:15076:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8b52116e0000 10000000:01000000:3.0:1787786521.653041:0:15076:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787786521.653046:0:15076:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8b5209123370 10000000:01000000:3.0:1787786521.653049:0:15076:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787786521.653053:0:15076:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8b5209123370 from 1 10000000:01000000:3.0:1787786521.653056:0:15076:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787786521.653314:0:15076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff3212 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786521.653325:0:15076:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff3212 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786521.653335:0:15076:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff3212 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786521.653363:0:15076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686812416:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787786521.653416:0:15076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786521.653748:0:15076:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5202f1ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787786521.653971:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686812416 00000100:00100000:2.0:1787786521.653979:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686812416 00000100:00100000:2.0:1787786521.654017:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787786521.654026:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523baee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+12:15076:x1874629686812416:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787786521.654039:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786521.654054:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5237aac400/0x450132973bff3219 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff3212 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786521.654178:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5237aac400/0x450132973bff3219 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff3212 expref: 13 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786521.654189:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5237aac400/0x450132973bff3219 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff3212 expref: 13 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786521.654199:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aac400, rc 0) 00000100:00100000:2.0:1787786521.654250:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523baee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+13:15076:x1874629686812416:12345-0@lo:101:mount.lustre.0 Request processed in 224us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786521.654258:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787786521.654364:0:15076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686812416:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787786521.654389:0:15076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff3212 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff3219 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786521.654399:0:15076:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff3212 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff3219 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786521.654422:0:15076:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787786521.654440:0:15076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff3212 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff3219 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786521.654447:0:15076:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b52421d4a00/0x450132973bff3212 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff3219 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786521.654465:0:15076:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787786521.654469:0:15076:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787786521.654475:0:15076:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787786521.654477:0:15076:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787786521.654504:0:15076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff3220 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786521.654512:0:15076:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff3220 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786521.654520:0:15076:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff3220 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786521.654544:0:15076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686812544:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787786521.654577:0:15076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786521.654599:0:15076:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5202f1ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787786521.654811:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686812544 00000100:00100000:2.0:1787786521.654830:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686812544 00000100:00100000:2.0:1787786521.654868:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787786521.654876:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523baed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+13:15076:x1874629686812544:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787786521.654885:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786521.654896:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b5237aac000/0x450132973bff3227 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff3220 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786521.654912:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5237aac000/0x450132973bff3227 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff3220 expref: 14 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786521.654921:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b5237aac000/0x450132973bff3227 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff3220 expref: 14 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786521.654928:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b5237aac000, rc 0) 00000100:00100000:2.0:1787786521.654970:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523baed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+14:15076:x1874629686812544:12345-0@lo:101:mount.lustre.0 Request processed in 94us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786521.654976:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787786521.655191:0:15076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686812544:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787786521.655203:0:15076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff3220 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff3227 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786521.655211:0:15076:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff3220 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff3227 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787786521.656365:0:15076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787786521.658704:0:15076:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787786521.659314:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787786521.659379:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787786521.659416:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787786521.659687:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787786521.659741:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787786521.659777:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787786521.659975:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787786521.659984:0:15076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787786521.660184:0:15076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686812672:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787786521.660259:0:15076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786521.660387:0:15076:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5202f1f240 going to sleep for 11 seconds 00000100:00100000:0.0:1787786521.660643:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686812672 00000100:00100000:0.0:1787786521.660651:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686812672 00000100:00100000:0.0:1787786521.660747:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787786521.660758:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523baeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+14:15076:x1874629686812672:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787786521.661428:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523baeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+14:15076:x1874629686812672:12345-0@lo:501:mount.lustre.0 Request processed in 670us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786521.661438:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787786521.661676:0:15076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686812672:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787786521.661720:0:15076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686812800:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787786521.661771:0:15076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786521.662055:0:15076:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5202f1f240 going to sleep for 11 seconds 00000100:00100000:2.0:1787786521.662198:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686812800 00000100:00100000:2.0:1787786521.662206:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686812800 00000100:00100000:2.0:1787786521.662251:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787786521.662261:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523baed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+14:15076:x1874629686812800:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787786521.662712:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523baed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+14:15076:x1874629686812800:12345-0@lo:503:mount.lustre.0 Request processed in 451us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786521.662720:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787786521.662871:0:15076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686812800:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787786521.664205:0:15076:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787786521.664299:0:15076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686812928:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787786521.664388:0:15076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786521.664480:0:15076:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5202f1f240 going to sleep for 11 seconds 00000100:00100000:0.0:1787786521.664664:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686812928 00000100:00100000:0.0:1787786521.664671:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686812928 00000100:00100000:2.0:1787786521.664777:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787786521.664812:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523baedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+14:15076:x1874629686812928:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787786521.665313:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523baedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+14:15076:x1874629686812928:12345-0@lo:502:mount.lustre.0 Request processed in 525us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786521.665321:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787786521.665433:0:15076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686812928:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787786521.666098:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787786521.666159:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787786521.666188:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787786521.666240:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787786521.666278:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787786521.666330:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787786521.666395:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787786521.666435:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787786521.666687:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1787786521.666749:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1787786521.666784:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1787786521.666869:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1787786521.666927:0:15076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5233338b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686813056:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787786521.667002:0:15076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786521.667057:0:15076:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b4be9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787786521.667158:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686813056 00000100:00100000:0.0:1787786521.667167:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686813056 00000100:00100000:0.0:1787786521.667203:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787786521.667213:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523baec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+14:15076:x1874629686813056:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787786521.667420:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523baec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+14:15076:x1874629686813056:12345-0@lo:502:mount.lustre.0 Request processed in 208us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786521.667428:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787786521.667669:0:15076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5233338b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686813056:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787786521.667755:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1787786521.667775:0:15076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1787786521.669334:0:15090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787786521.669345:0:15090:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1787786521.669352:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787786521.669354:0:15090:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1787786521.669362:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787786521.669403:0:15090:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8b51010c99b8) 00000020:00000080:0.0:1787786521.669427:0:15090:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787786521.669436:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787786521.669598:0:15090:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b52116e0000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1787786521.669608:0:15090:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787786521.669616:0:15090:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x450132973bff3235 00010000:00010000:0.0:1787786521.675019:0:15090:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:0.0:1787786521.676717:0:15090:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:0.0:1787786521.679595:0:15090:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1787786521.681519:0:15090:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1787786521.681533:0:15090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787786521.681540:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786521.681542:0:15090:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1787786521.681546:0:15090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1787786521.681549:0:15090:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1787786521.681551:0:15090:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787786521.681552:0:15090:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1787786521.681554:0:15090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1787786521.681557:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786521.681558:0:15090:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1787786521.681561:0:15090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787786521.681564:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786521.681565:0:15090:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787786521.681568:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787786521.681570:0:15090:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787786521.681572:0:15090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787786521.681574:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786521.681576:0:15090:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787786521.681578:0:15090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787786521.681580:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786521.681581:0:15090:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787786521.681585:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787786521.681653:0:15090:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787786521.681657:0:15090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786521.681658:0:15090:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787786521.681661:0:15090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1787786521.682052:0:15076:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1787786521.682097:0:15076:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787786521.682123:0:15076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff3220 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff3227 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786521.682136:0:15076:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b52421d4000/0x450132973bff3220 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff3227 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786521.682145:0:15076:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b52116e0000 from 1 10000000:01000000:3.0:1787786521.682147:0:15076:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787786521.682182:0:15076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b52421d5a00/0x450132973bff323c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786521.682191:0:15076:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b52421d5a00/0x450132973bff323c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786521.682202:0:15076:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b52421d5a00/0x450132973bff323c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786521.682225:0:15076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686813184:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787786521.682306:0:15076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786521.682480:0:15076:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5225de9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787786521.682668:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686813184 00000100:00100000:0.0:1787786521.682676:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686813184 00000100:00100000:0.0:1787786521.682732:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787786521.682742:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523baec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+14:15076:x1874629686813184:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787786521.682756:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786521.682769:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b520912c400/0x450132973bff3243 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff323c expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786521.682825:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b520912c400/0x450132973bff3243 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff323c expref: 15 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786521.682837:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b520912c400/0x450132973bff3243 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff323c expref: 15 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786521.682960:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912c400, rc 0) 00000100:00100000:0.0:1787786521.683147:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523baec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+15:15076:x1874629686813184:12345-0@lo:101:mount.lustre.0 Request processed in 406us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786521.683154:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787786521.685690:0:15076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d7840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686813184:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787786521.685718:0:15076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b52421d5a00/0x450132973bff323c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff3243 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786521.685731:0:15076:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b52421d5a00/0x450132973bff323c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff3243 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787786521.687227:0:15076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787786521.688737:0:15076:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787786521.689298:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787786521.689349:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787786521.689430:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787786521.689438:0:15076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787786521.689611:0:15076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5233338b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686813312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787786521.689679:0:15076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786521.689782:0:15076:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b4be9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787786521.693343:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686813312 00000100:00100000:3.0:1787786521.693356:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686813312 00000100:00100000:3.0:1787786521.693421:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787786521.693431:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+15:15076:x1874629686813312:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787786521.693982:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+15:15076:x1874629686813312:12345-0@lo:501:mount.lustre.0 Request processed in 550us (4300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786521.693990:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787786521.694137:0:15076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5233338b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686813312:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787786521.694197:0:15076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5233338b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686813440:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787786521.694248:0:15076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786521.694284:0:15076:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b4be9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787786521.694388:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686813440 00000100:00100000:0.0:1787786521.694394:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686813440 00000100:00100000:0.0:1787786521.694423:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787786521.694431:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+15:15076:x1874629686813440:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787786521.694608:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+15:15076:x1874629686813440:12345-0@lo:503:mount.lustre.0 Request processed in 177us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786521.694616:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787786521.694758:0:15076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5233338b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686813440:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787786521.695662:0:15076:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787786521.695724:0:15076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5233338b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686813568:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787786521.695771:0:15076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786521.695922:0:15076:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b4be9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787786521.698665:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686813568 00000100:00100000:0.0:1787786521.698678:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686813568 00000100:00100000:0.0:1787786521.698734:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787786521.698743:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+15:15076:x1874629686813568:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787786521.699013:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+15:15076:x1874629686813568:12345-0@lo:502:mount.lustre.0 Request processed in 270us (3240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786521.699021:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787786521.699092:0:15076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5233338b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686813568:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787786521.699380:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787786521.699431:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787786521.699487:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787786521.699519:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787786521.699545:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787786521.699585:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787786521.699633:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787786521.699660:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1787786521.699699:0:15076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103293c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686813696:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787786521.699745:0:15076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786521.699781:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686813696 00000100:00100000:0.0:1787786521.699785:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686813696 00000100:00100000:0.0:1787786521.699830:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787786521.699837:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+15:15076:x1874629686813696:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787786521.699957:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+15:15076:x1874629686813696:12345-0@lo:502:mount.lustre.0 Request processed in 119us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786521.699963:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787786521.699999:0:15076:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5232add540 going to sleep for 11 seconds 00000100:00100000:0.0:1787786521.700013:0:15076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103293c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686813696:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787786521.700081:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787786521.700090:0:15076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1787786521.703638:0:15094:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787786521.703653:0:15094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786521.703655:0:15094:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787786521.703663:0:15094:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b52116e0000 00000020:00000080:2.0:1787786521.703665:0:15094:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787786521.703672:0:15094:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787786521.703675:0:15094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786521.703676:0:15094:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787786521.703693:0:15094:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787786521.703696:0:15094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786521.703697:0:15094:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787786521.703700:0:15094:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b52116e0000 00000020:00000080:2.0:1787786521.703702:0:15094:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787786521.705420:0:15094:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787786521.705435:0:15094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786521.705437:0:15094:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787786521.705442:0:15094:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787786521.705446:0:15094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786521.705448:0:15094:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787786521.705671:0:15094:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8b52116e0000 00000020:00000080:2.0:1787786521.705674:0:15094:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787786521.707836:0:15094:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787786521.707847:0:15094:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786521.707849:0:15094:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787786521.708034:0:15094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1787786521.708275:0:15076:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787786521.708302:0:15076:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787786521.708324:0:15076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b52421d5a00/0x450132973bff323c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff3243 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786521.708336:0:15076:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b52421d5a00/0x450132973bff323c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff3243 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786521.708390:0:15076:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787786521.708393:0:15076:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8b52116e0000 10000000:01000000:3.0:1787786521.708397:0:15076:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8b52116e0000 10000000:01000000:3.0:1787786521.708401:0:15076:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787786521.708406:0:15076:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8b52116e0000 from 1 10000000:01000000:3.0:1787786521.708409:0:15076:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787786521.708444:0:15076:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b52421d5c00/0x450132973bff324a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786521.708462:0:15076:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b52421d5c00/0x450132973bff324a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786521.708487:0:15076:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b52421d5c00/0x450132973bff324a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786521.708510:0:15076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686813824:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787786521.708574:0:15076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786521.708621:0:15076:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5225de9900 going to sleep for 11 seconds 00000100:00100000:1.0:1787786521.708740:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686813824 00000100:00100000:1.0:1787786521.708746:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686813824 00000100:00100000:1.0:1787786521.708816:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787786521.708825:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+15:15076:x1874629686813824:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787786521.708838:0:14385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786521.708851:0:14385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b523b4d9800/0x450132973bff3251 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff324a expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786521.708882:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b523b4d9800/0x450132973bff3251 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff324a expref: 16 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786521.708893:0:14385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b523b4d9800/0x450132973bff3251 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff324a expref: 16 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786521.708901:0:14385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523b4d9800, rc 0) 00000100:00100000:1.0:1787786521.708940:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+16:15076:x1874629686813824:12345-0@lo:101:mount.lustre.0 Request processed in 117us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786521.708947:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787786521.708990:0:15076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d52c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686813824:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787786521.709003:0:15076:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b52421d5c00/0x450132973bff324a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff3251 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786521.709019:0:15076:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b52421d5c00/0x450132973bff324a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff3251 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787786521.709654:0:15076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1787786521.709988:0:15076:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787786521.710215:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1787786521.710259:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1787786521.710295:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1787786521.710341:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1787786521.710394:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1787786521.710444:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1787786521.710482:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1787786521.710527:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1787786521.710566:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1787786521.710595:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1787786521.710621:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1787786521.710673:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1787786521.710706:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1787786521.710734:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1787786521.710817:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1787786521.710859:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1787786521.710891:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1787786521.710935:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1787786521.710965:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1787786521.710993:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1787786521.711030:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1787786521.711060:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1787786521.711087:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1787786521.711146:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1787786521.711180:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1787786521.711214:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1787786521.711277:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1787786521.711313:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1787786521.711406:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1787786521.711414:0:15076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1787786521.711515:0:15076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c09680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686813952:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787786521.711582:0:15076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786521.712475:0:15076:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5206fd3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787786521.712534:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686813952 00000100:00100000:3.0:1787786521.712542:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686813952 00000100:00100000:3.0:1787786521.712592:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787786521.712600:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+16:15076:x1874629686813952:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787786521.713768:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+16:15076:x1874629686813952:12345-0@lo:501:mount.lustre.0 Request processed in 1163us (2179us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786521.713780:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787786521.714261:0:15076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c09680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686813952:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787786521.714315:0:15076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c09680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686814080:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787786521.714380:0:15076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786521.716021:0:15076:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5206fd3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787786521.723760:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686814080 00000100:00100000:2.0:1787786521.723939:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686814080 00000100:00100000:2.0:1787786521.724082:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787786521.724094:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+16:15076:x1874629686814080:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787786521.724810:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+16:15076:x1874629686814080:12345-0@lo:503:mount.lustre.0 Request processed in 697us (10421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786521.724820:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787786521.728525:0:15076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c09680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686814080:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787786521.730535:0:15076:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787786521.730644:0:15076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103293c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686814208:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787786521.730749:0:15076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786521.730821:0:15076:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52088396c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787786521.731595:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686814208 00000100:00100000:2.0:1787786521.731609:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686814208 00000100:00100000:2.0:1787786521.731675:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787786521.731685:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+16:15076:x1874629686814208:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787786521.733751:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+16:15076:x1874629686814208:12345-0@lo:502:mount.lustre.0 Request processed in 2059us (2994us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786521.733779:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787786521.734064:0:15076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103293c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686814208:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787786521.734397:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787786521.734469:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787786521.734501:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787786521.734545:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787786521.734582:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787786521.734651:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787786521.734713:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787786521.734747:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787786521.734822:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787786521.735094:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787786521.735133:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787786521.735188:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787786521.735233:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787786521.735271:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787786521.735320:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787786521.735355:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787786521.735403:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787786521.735483:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787786521.735524:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787786521.735559:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787786521.735612:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787786521.735647:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787786521.735699:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787786521.735750:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787786521.735784:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1787786521.735841:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1787786521.736022:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1787786521.736142:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1787786521.736180:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1787786521.736241:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1787786521.736283:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1787786521.736322:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1787786521.736355:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1787786521.736415:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1787786521.736523:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1787786521.736572:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1787786521.736609:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1787786521.736651:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1787786521.736732:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1787786521.736779:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1787786521.737194:0:15076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103293c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686814336:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787786521.737277:0:15076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786521.737324:0:15076:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52088396c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787786521.737496:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686814336 00000100:00100000:2.0:1787786521.737503:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686814336 00000100:00100000:2.0:1787786521.737555:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787786521.737565:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+16:15076:x1874629686814336:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787786521.737819:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+16:15076:x1874629686814336:12345-0@lo:502:mount.lustre.0 Request processed in 255us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786521.737827:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787786521.738067:0:15076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103293c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686814336:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787786521.738154:0:15076:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1787786521.738169:0:15076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787786521.739268:0:15099:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787786521.739289:0:15099:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8b51010ccd28) 00000020:00000080:0.0:1787786521.739312:0:15099:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1787786521.739397:0:15099:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b52116e0000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787786521.739402:0:15099:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8b52116e0000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787786521.739405:0:15099:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b52116e0000 3 00010000:00080000:0.0:1787786521.739448:0:15099:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b52329a0000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.134@tcp at head 00010000:00010000:0.0:1787786521.741613:0:15099:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1787786521.743954:0:15099:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787786521.744000:0:15099:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787786521.744015:0:15099:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x450132973bff325f 00000100:00080000:0.0:1787786521.744085:0:15099:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787786521.744093:0:15099:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8b52329a0000 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:0.0:1787786521.744134:0:15099:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5103293c00 x1874629686814464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787786521.744179:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874629686814464:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787786521.744244:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786521.744307:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686814464 00000100:00100000:0.0:1787786521.744314:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686814464 00000100:00100000:0.0:1787786521.744342:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787786521.744355:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103292d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1874629686814464:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1787786521.744388:0:14393:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:0.0:1787786521.744417:0:14393:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x450132973bff3266 00000004:00100000:0.0:1787786521.744493:0:14393:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787786521.744520:0:14393:0:(import.c:65:import_set_state_nolock()) ffff8b52329a4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787786521.744566:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103292d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874629686814464:12345-0@lo:38:llog_process_th.0 Request processed in 211us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786521.744573:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787786521.744614:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8b5103293c00 x1874629686814464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787786531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786521.744624:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787786521.744632:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1787786521.744638:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787786521.744641:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787786521.744644:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b52329a0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787786521.744648:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1874629686814464:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1787786521.744667:0:15099:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787786521.744686:0:12641:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787786521.744690:0:12641:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787786521.744694:0:12641:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787786521.744697:0:12641:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787786521.744732:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874629686814592:0@lo:400:kworker.0 00000100:00100000:0.0:1787786521.744755:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786521.744823:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686814592 00000100:00100000:0.0:1787786521.744828:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686814592 00000100:00100000:0.0:1787786521.744856:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787786521.744862:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b51032930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874629686814592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786521.744899:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b51032930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874629686814592:12345-0@lo:400:kworker.0 Request processed in 37us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786521.744905:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787786521.744932:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8b5103293c00 x1874629686814592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787786537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786521.744942:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103293c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874629686814592:0@lo:400:kworker.0 00000040:00080000:0.0:1787786521.746294:0:15099:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1787786521.747519:0:15076:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787786521.747559:0:15076:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787786521.747577:0:15076:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b52421d5c00/0x450132973bff324a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff3251 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786521.747591:0:15076:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b52421d5c00/0x450132973bff324a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff3251 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787786521.747657:0:15076:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787786521.747660:0:15076:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787786521.747661:0:15076:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787786521.747663:0:15076:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787786521.747664:0:15076:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787786521.747666:0:15076:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787786521.747667:0:15076:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787786521.747669:0:15076:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787786521.747671:0:15076:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787786521.747674:0:15076:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1787786521.747677:0:15076:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787786521.747679:0:15076:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787786521.747680:0:15076:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787786521.747681:0:15076:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787786521.747682:0:15076:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787786521.747690:0:15076:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787786521.747691:0:15076:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787786521.747692:0:15076:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787786521.747693:0:15076:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787786521.747719:0:15076:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1787786521.747737:0:15076:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523333b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686814720:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787786521.747825:0:15076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786521.747866:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686814720 00000100:00100000:2.0:1787786521.747872:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686814720 00000100:00100000:2.0:1787786521.747915:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787786521.747923:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+16:15076:x1874629686814720:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787786521.747969:0:14386:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1787786521.747984:0:14386:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1787786521.748360:0:15076:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b4be180 going to sleep for 11 seconds 20000000:01000000:3.0:1787786521.813108:0:14386:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787786521.813188:0:14386:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787786521.817490:0:14409:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787786521.817504:0:14409:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787786521.817531:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b5237aace00/0x450132973bff326d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786521.817551:0:14409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b5237aac600/0x450132973bff31da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff31d3 expref: 16 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786521.817561:0:14409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b5237aace00/0x450132973bff326d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786521.817609:0:14409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b5237aac600/0x450132973bff31da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff31d3 expref: 16 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786521.817624:0:14409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b5237aac600/0x450132973bff31da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff31d3 expref: 16 pid: 14388 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786521.817639:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5233338780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14409:1874629686814848:0@lo:104: 00000100:00100000:2.0:1787786521.817722:0:14409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786521.817776:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523b4be900 going to sleep for 11 seconds 00000100:00100000:3.0:1787786521.818085:0:14377:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686814848 00000100:00100000:3.0:1787786521.818094:0:14377:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686814848 00000100:00100000:3.0:1787786521.818152:0:14377:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787786521.818161:0:14377:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5233339e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+3:14409:x1874629686814848:12345-0@lo:104: 00010000:00010000:3.0:1787786521.818175:0:14377:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff8b5237aad200/0x450132973bff31d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff31da expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786521.818234:0:14377:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787786521.818241:0:14377:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5233339e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+3:14409:x1874629686814848:12345-0@lo:104: Request processed in 81us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786521.818248:0:14377:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1787786521.818272:0:14382:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787786521.818285:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b5237aad200/0x450132973bff31d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff31da expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786521.818293:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aad200 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:3.0:1787786521.818297:0:14382:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b5237aad200/0x450132973bff31d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff31da expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786521.818305:0:14382:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b5237aad200/0x450132973bff31d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff31da expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787786521.818325:0:14382:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b5237aad200/0x450132973bff31d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff31da expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786521.818330:0:14382:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787786521.818358:0:14382:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b5237aad200/0x450132973bff31d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff31da expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786521.818374:0:14382:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787786521.818396:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b5237aad200/0x450132973bff31d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff31da expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786521.818403:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b5237aad200/0x450132973bff31d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff31da expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786521.818580:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786521.818582:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786521.818584:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786521.818654:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787786521.818668:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3314:1874629686814976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787786521.818702:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786521.818759:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5233338780 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14409:1874629686814848:0@lo:104: 00010000:00010000:2.0:1787786521.818780:0:14409:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b5237aace00/0x450132973bff326d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786521.818898:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686814976 00000100:00100000:3.0:1787786521.818903:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686814976 00010000:00010000:3.0:1787786521.818926:0:14380:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b5237aac600/0x450132973bff31da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff31d3 expref: 17 pid: 14388 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786521.818966:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787786521.818973:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52333392c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+17:3314:x1874629686814976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787786521.818985:0:14380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786521.818990:0:14380:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b5237aac600/0x450132973bff31da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff31d3 expref: 17 pid: 14388 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786521.819001:0:14380:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b5237aac600/0x450132973bff31da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff31d3 expref: 17 pid: 14388 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786521.819014:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5237aac600/0x450132973bff31da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff31d3 expref: 17 pid: 14388 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786521.819178:0:14380:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b5237aace00/0x450132973bff326d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786521.819187:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b5237aace00/0x450132973bff326d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787786521.819205:0:14380:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001701814s 00010000:00010000:3.0:1787786521.819209:0:14380:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b5237aace00/0x450132973bff326d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786521.819217:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b5237aace00/0x450132973bff326d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786521.819223:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b5237aace00/0x450132973bff326d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786521.819230:0:14380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b5237aace00/0x450132973bff326d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786521.819242:0:14380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aace00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:3.0:1787786521.819246:0:14380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b5237aace00/0x450132973bff326d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786521.819254:0:14380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b5237aace00/0x450132973bff326d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786521.819275:0:14380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b5237aace00/0x450132973bff326d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786521.819284:0:14380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787786521.819331:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52333392c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+16:3314:x1874629686814976:12345-0@lo:103:ldlm_bl.0 Request processed in 358us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786521.819339:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787786521.819549:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3314:1874629686814976:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787786521.819574:0:14409:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b5237aace00/0x450132973bff326d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786521.819582:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b5237aace00/0x450132973bff326d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786521.819588:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5237aace00/0x450132973bff326d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786521.827522:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+15:15076:x1874629686814720:12345-0@lo:253:mount.lustre.0 Request processed in 79589us (79687us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786521.827537:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787786521.827631:0:15076:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523333b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15076:1874629686814720:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1787786521.827647:0:15076:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787786521.827651:0:15076:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787786521.827653:0:15076:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787786521.827654:0:15076:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787786521.827655:0:15076:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787786521.827656:0:15076:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787786521.827657:0:15076:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787786521.827659:0:15076:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787786521.827661:0:15076:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787786521.827662:0:15076:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787786521.827679:0:15076:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787786521.833601:0:15076:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787786521.833766:0:15076:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787786521.834225:0:15076:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787786521.834392:0:15076:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787786521.834625:0:15076:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787786521.835002:0:15076:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787786521.835839:0:15076:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787786521.903497:0:15076:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787786521.903508:0:15076:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787786521.903547:0:15076:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787786521.904114:0:15076:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.134@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787786521.904136:0:15076:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787786521.904168:0:15076:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1787786521.997897:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786523.017983:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787786523.023071:0:14390:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787786523.023081:0:14390:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8b51033ae000 from 7 10000000:01000000:0.0:1787786523.023086:0:14390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787786523.023135:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff3274 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786523.023148:0:14390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff3274 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786523.023160:0:14390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff3274 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786523.023187:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103292580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686815104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787786523.023254:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786523.023318:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686815104 00000100:00100000:0.0:1787786523.023318:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b523d2b5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787786523.023330:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686815104 00000100:00100000:3.0:1787786523.023401:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787786523.023417:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+15:14390:x1874629686815104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787786523.023430:0:14385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786523.023443:0:14385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b52421d5600/0x450132973bff327b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff3274 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786523.023468:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b52421d5600/0x450132973bff327b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff3274 expref: 16 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786523.023478:0:14385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b52421d5600/0x450132973bff327b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff3274 expref: 16 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786523.023488:0:14385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b52421d5600, rc 0) 00000100:00100000:3.0:1787786523.023537:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+16:14390:x1874629686815104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786523.023544:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787786523.025609:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103292580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686815104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787786523.025641:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff3274 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff327b expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786523.025653:0:14390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff3274 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff327b expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786523.025734:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523333b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686815232:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787786523.025820:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786523.025856:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52304be780 going to sleep for 11 seconds 00000100:00100000:3.0:1787786523.026397:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686815232 00000100:00100000:3.0:1787786523.026404:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686815232 00000100:00100000:3.0:1787786523.026461:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787786523.026470:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+16:14390:x1874629686815232:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787786523.026492:0:14386:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787786523.026508:0:14386:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787786523.026511:0:14386:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1787786523.026610:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+16:14390:x1874629686815232:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 140us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786523.026618:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787786523.026705:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523333b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686815232:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1787786523.026762:0:14390:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787786523.026770:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff3274 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff327b expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786523.026779:0:14390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff3274 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff327b expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786524.041993:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786525.071060:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786526.090315:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786527.114030:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787786527.250693:0:481:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787786527.250699:0:481:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787786527.250703:0:481:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787786527.250706:0:481:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787786527.250828:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103290f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3314:1874629686815360:0@lo:400:kworker.0 00000100:00100000:3.0:1787786527.250907:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874629686815488:0@lo:400:kworker.0 00000100:00100000:0.0:1787786527.250917:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786527.250955:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786527.250991:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787786527.251012:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103291e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874629686815616:0@lo:400:kworker.0 00000100:00100000:3.0:1787786527.251045:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786527.251857:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686815360 00000100:00100000:1.0:1787786527.251867:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686815360 00000100:00100000:1.0:1787786527.251915:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787786527.251923:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+16:3314:x1874629686815360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786527.251983:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+16:3314:x1874629686815360:12345-0@lo:400:kworker.0 Request processed in 60us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786527.251989:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787786527.256946:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686815488 00000100:00100000:1.0:1787786527.256961:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686815488 00000100:00100000:1.0:1787786527.257011:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686815616 00000100:00100000:1.0:1787786527.257015:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686815616 00000100:00100000:1.0:1787786527.257053:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787786527.257063:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874629686815488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786527.257148:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874629686815488:12345-0@lo:400:kworker.0 Request processed in 87us (6192us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786527.257298:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787786527.257375:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787786527.257382:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874629686815616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786527.257411:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874629686815616:12345-0@lo:400:kworker.0 Request processed in 31us (6367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786527.257416:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1787786527.257508:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787786527.257542:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5103291e00 x1874629686815616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787786543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786527.257557:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103291e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874629686815616:0@lo:400:kworker.0 00010000:00080000:3.0:1787786527.257568:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5103293480 x1874629686815488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787786543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786527.257575:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874629686815488:0@lo:400:kworker.0 00000100:00100000:0.0:1787786527.259180:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103290f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3314:1874629686815360:0@lo:400:kworker.0 00010000:00010000:0.0:1787786528.152939:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786529.163016:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787786529.307065:0:15443:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg434-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:1.0:1787786529.674686:0:14428:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787786530.185970:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786531.210582:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786532.237143:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787786532.368995:0:481:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787786532.369002:0:481:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787786532.369005:0:481:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787786532.369008:0:481:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787786532.369155:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103290f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3313:1874629686815744:0@lo:400:kworker.0 00000100:00100000:0.0:1787786532.369263:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786532.369322:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787786532.369329:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686815872:0@lo:400:kworker.0 00000100:00100000:0.0:1787786532.369355:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786532.369388:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103291e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874629686816000:0@lo:400:kworker.0 00000100:00100000:0.0:1787786532.369412:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786532.369461:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686815744 00000100:00100000:0.0:1787786532.369468:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686815744 00000100:00100000:0.0:1787786532.369511:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787786532.369520:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+16:3313:x1874629686815744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786532.369569:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+16:3313:x1874629686815744:12345-0@lo:400:kworker.0 Request processed in 50us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786532.369576:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787786532.369609:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686815872 00000100:00100000:0.0:1787786532.369613:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686815872 00000100:00100000:0.0:1787786532.369638:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686816000 00000100:00100000:0.0:1787786532.369641:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686816000 00000100:00100000:0.0:1787786532.370151:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787786532.370171:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103293c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686815872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786532.370214:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103293c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686815872:12345-0@lo:400:kworker.0 Request processed in 56us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786532.370221:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787786532.370233:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787786532.370239:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103292580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874629686816000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786532.370268:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103292580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874629686816000:12345-0@lo:400:kworker.0 Request processed in 30us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786532.370275:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787786532.370316:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5103293480 x1874629686815872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787786548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786532.370331:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686815872:0@lo:400:kworker.0 00000100:00100000:0.0:1787786532.370342:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103290f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3313:1874629686815744:0@lo:400:kworker.0 00000100:00080000:0.0:1787786532.370370:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787786532.370399:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5103291e00 x1874629686816000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787786548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786532.370409:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103291e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1874629686816000:0@lo:400:kworker.0 00000100:00100000:1.0:1787786533.001882:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787786517/real 1787786517] req@ffff8b5103290000 x1874629686811520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787786532 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786533.001916:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8b5103290000 x1874629686811520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787786532 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786533.001926:0:3310:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787786517/real 1787786517] req@ffff8b51032903c0 x1874629686811648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787786532 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786533.001937:0:3310:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8b51032903c0 x1874629686811648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787786532 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787786533.001958:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b523d2c4800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787786533.001977:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787786533.001981:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874629686811520:0@lo:8:kworker.0 00000100:00080000:1.0:1787786533.001987:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b52117ba000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787786533.001992:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787786533.001995:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b51032903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874629686811648:0@lo:8:kworker.0 00000100:00100000:1.0:1787786533.002446:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103291e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3312:1874629686816128:0@lo:400:kworker.0 00000100:00100000:1.0:1787786533.002537:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786533.002637:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686816128 00000100:00100000:2.0:1787786533.002646:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686816128 00000100:00100000:2.0:1787786533.002705:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787786533.002715:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+16:3312:x1874629686816128:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787786533.003077:0:12641:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787786533.003082:0:12641:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1787786533.003085:0:12641:0:(import.c:65:import_set_state_nolock()) ffff8b523d2c4800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787786533.003090:0:12641:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 443 00000100:00080000:0.0:1787786533.003094:0:12641:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787786533.003100:0:12641:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8b523d2c4800 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:0.0:1787786533.003125:0:12641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5103290f00 x1874629686816256/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787786533.003142:0:12641:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787786533.003145:0:12641:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787786533.003158:0:12641:0:(import.c:65:import_set_state_nolock()) ffff8b52117ba000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787786533.003161:0:12641:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 443 00000100:00080000:0.0:1787786533.003164:0:12641:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1787786533.003167:0:12641:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8b52117ba000 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:0.0:1787786533.003179:0:12641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5103293480 x1874629686816384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787786533.003224:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103290780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686816512:0@lo:400:kworker.0 00000100:00100000:0.0:1787786533.003259:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786533.003285:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787786533.003291:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103293840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686816640:0@lo:400:kworker.0 00000100:00100000:0.0:1787786533.003314:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786533.003356:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686816512 00000100:00100000:0.0:1787786533.003361:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686816512 00000100:00100000:0.0:1787786533.003393:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686816640 00000100:00100000:0.0:1787786533.003396:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686816640 00000100:00100000:0.0:1787786533.003418:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787786533.003424:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103291680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686816512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786533.003467:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103291680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686816512:12345-0@lo:400:kworker.0 Request processed in 43us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786533.003474:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787786533.003489:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787786533.003510:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103290b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686816640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786533.003538:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103290b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686816640:12345-0@lo:400:kworker.0 Request processed in 43us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786533.003544:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1787786533.003582:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5103293840 x1874629686816640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787786549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786533.003595:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103293840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686816640:0@lo:400:kworker.0 00010000:00080000:0.0:1787786533.003606:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5103290780 x1874629686816512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787786549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786533.003615:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103290780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686816512:0@lo:400:kworker.0 00000100:00100000:0.0:1787786533.003638:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103290f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874629686816256:0@lo:8:kworker.0 00000100:00100000:0.0:1787786533.003664:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786533.003693:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874629686816384:0@lo:8:kworker.0 00000100:00100000:0.0:1787786533.003712:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786533.003763:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686816256 00000100:00100000:0.0:1787786533.003774:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686816256 00000100:00100000:0.0:1787786533.003815:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686816384 00000100:00100000:0.0:1787786533.003818:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686816384 00000100:00100000:0.0:1787786533.003827:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787786533.003832:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103290780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1874629686816256:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787786533.003854:0:15078:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:0.0:1787786533.003884:0:15078:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x450132973bff3282 00002000:00100000:0.0:1787786533.003897:0:15078:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8b52329a7800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113935 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787786533.003902:0:15078:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787786533.003904:0:15078:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787786533.004247:0:15078:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787786533.004269:0:15078:0:(import.c:65:import_set_state_nolock()) ffff8b52329a3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787786533.004316:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103290780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1874629686816256:12345-0@lo:8:kworker.0 Request processed in 483us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786533.004323:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787786533.004336:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787786533.004340:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103293840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1874629686816384:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787786533.004351:0:15078:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787786533.010613:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+16:3312:x1874629686816128:12345-0@lo:400:kworker.0 Request processed in 7886us (8062us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786533.010648:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787786533.013690:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103291e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3312:1874629686816128:0@lo:400:kworker.0 00010000:00080000:1.0:1787786533.013778:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5103290f00 x1874629686816256/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787786553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787786533.013806:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787786533.013814:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787786533.013823:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787786533.013829:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787786533.013832:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b523d2c4800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787786533.013905:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787786533.013911:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103290f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874629686816256:0@lo:8:kworker.0 00000004:00080000:2.0:1787786533.014682:0:14416:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1787786533.014708:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52333383c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14416:1874629686816896:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787786533.014777:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786533.014826:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5219485480 going to sleep for 11 seconds 00000100:00100000:2.0:1787786533.014850:0:15080:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1787786533.014856:0:15080:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1787786533.014942:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787786533.014952:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5233338780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686816768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787786533.014979:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786533.015009:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686816768 00000100:00100000:2.0:1787786533.015015:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686816768 00000100:00080000:1.0:1787786533.015201:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787786533.015614:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787786533.015625:0:15081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523333b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874629686816768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787786533.015690:0:15081:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787786533.015737:0:15081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523333b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874629686816768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786533.015744:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787786533.015784:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8b5233338780 x1874629686816768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786549 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786533.015822:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5233338780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686816768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787786533.015864:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686816896 00000100:00100000:2.0:1787786533.015868:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686816896 00000100:00100000:2.0:1787786533.015955:0:15614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787786533.015962:0:15614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5233339a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14416:x1874629686816896:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787786533.019588:0:14415:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787786533.019952:0:14415:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 459378160842ns, next at 0ns, rc = 0 00002000:00080000:2.0:1787786533.025709:0:15614:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787786533.025731:0:15614:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1787786533.025738:0:15614:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000100:00100000:0.0:1787786533.029415:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103293840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1874629686816384:12345-0@lo:8:kworker.0 Request processed in 25068us (25695us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787786533.029428:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1787786533.029906:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b52117ba000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787786533.029912:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1787786533.029916:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874629686816384:0@lo:8:kworker.0 00002000:00010000:3.0:1787786533.060397:0:15614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787786533.060410:0:15614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090206775/0x450132973bff3289 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.060427:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787786533.060432:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787786533.060439:0:15614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090206775/0x450132973bff3289 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.060456:0:15614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090206775/0x450132973bff3289 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.060467:0:15614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090206775/0x450132973bff3289 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.060487:0:15614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090206775/0x450132973bff3289 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.060514:0:15614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787786533.061096:0:15614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787786533.061103:0:15614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028314f42/0x450132973bff3290 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.061115:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787786533.061119:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787786533.061123:0:15614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028314f42/0x450132973bff3290 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.061132:0:15614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028314f42/0x450132973bff3290 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.061139:0:15614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028314f42/0x450132973bff3290 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.061158:0:15614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028314f42/0x450132973bff3290 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.061178:0:15614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787786533.061194:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787786533.061200:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090206775/0x450132973bff3289 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.061214:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d5400 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:3.0:1787786533.061219:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090206775/0x450132973bff3289 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.061229:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090206775/0x450132973bff3289 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.061248:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090206775/0x450132973bff3289 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.061255:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090206775/0x450132973bff3289 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.061273:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787786533.061277:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028314f42/0x450132973bff3290 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.061285:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d4400 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:3.0:1787786533.061288:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028314f42/0x450132973bff3290 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.061295:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028314f42/0x450132973bff3290 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.061304:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028314f42/0x450132973bff3290 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.061317:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028314f42/0x450132973bff3290 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.061331:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786533.061333:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786533.061335:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786533.061750:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787786533.062976:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1787786533.063344:0:15614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787786533.063353:0:15614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa150bd9/0x450132973bff3297 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.063369:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787786533.063374:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787786533.063380:0:15614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa150bd9/0x450132973bff3297 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.063392:0:15614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa150bd9/0x450132973bff3297 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.063402:0:15614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa150bd9/0x450132973bff3297 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.063409:0:15614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa150bd9/0x450132973bff3297 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.063428:0:15614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787786533.063440:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787786533.063451:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa150bd9/0x450132973bff3297 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.063460:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d4600 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:3.0:1787786533.063464:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa150bd9/0x450132973bff3297 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.063473:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa150bd9/0x450132973bff3297 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.063491:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa150bd9/0x450132973bff3297 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.063499:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa150bd9/0x450132973bff3297 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.063515:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786533.063517:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786533.063518:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787786533.064570:0:15614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787786533.064579:0:15614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000377b8f78/0x450132973bff329e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.064592:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787786533.064596:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787786533.064601:0:15614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000377b8f78/0x450132973bff329e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.064624:0:15614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000377b8f78/0x450132973bff329e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.072354:0:15614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000377b8f78/0x450132973bff329e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.072382:0:15614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000377b8f78/0x450132973bff329e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.072412:0:15614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787786533.073107:0:15614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787786533.073115:0:15614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f35f8e72/0x450132973bff32a5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.073132:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787786533.073137:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787786533.073144:0:15614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f35f8e72/0x450132973bff32a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.073169:0:15614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f35f8e72/0x450132973bff32a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.073178:0:15614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f35f8e72/0x450132973bff32a5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.073198:0:15614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f35f8e72/0x450132973bff32a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.073225:0:15614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1787786533.073624:0:15614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787786533.073630:0:15614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000419240ff/0x450132973bff32ac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.073640:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787786533.073644:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787786533.073647:0:15614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000419240ff/0x450132973bff32ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.073656:0:15614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000419240ff/0x450132973bff32ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.073663:0:15614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000419240ff/0x450132973bff32ac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.073670:0:15614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000419240ff/0x450132973bff32ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.073680:0:15614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1787786533.074078:0:15614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787786533.074084:0:15614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1ff83e5/0x450132973bff32b3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.074100:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787786533.074103:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787786533.074107:0:15614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1ff83e5/0x450132973bff32b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.074116:0:15614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1ff83e5/0x450132973bff32b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.074125:0:15614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1ff83e5/0x450132973bff32b3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.074132:0:15614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1ff83e5/0x450132973bff32b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.074141:0:15614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1787786533.074555:0:15614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787786533.074560:0:15614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039328e0f/0x450132973bff32ba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.074569:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787786533.074572:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787786533.074576:0:15614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000039328e0f/0x450132973bff32ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.074585:0:15614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000039328e0f/0x450132973bff32ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.074603:0:15614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000039328e0f/0x450132973bff32ba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.074609:0:15614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000039328e0f/0x450132973bff32ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.074617:0:15614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1787786533.075054:0:15614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787786533.075060:0:15614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d0b4ad8/0x450132973bff32c1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.075069:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787786533.075072:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787786533.075076:0:15614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d0b4ad8/0x450132973bff32c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.075091:0:15614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d0b4ad8/0x450132973bff32c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.075099:0:15614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d0b4ad8/0x450132973bff32c1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.075599:0:14382:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1787786533.075610:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000377b8f78/0x450132973bff329e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.075629:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d5800 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:0.0:1787786533.075641:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000377b8f78/0x450132973bff329e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.075651:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000377b8f78/0x450132973bff329e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.075671:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000377b8f78/0x450132973bff329e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.075678:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000377b8f78/0x450132973bff329e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.075700:0:14382:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1787786533.075704:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f35f8e72/0x450132973bff32a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.075710:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb6000 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:0.0:1787786533.075714:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f35f8e72/0x450132973bff32a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.075721:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f35f8e72/0x450132973bff32a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.075730:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f35f8e72/0x450132973bff32a5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.075744:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f35f8e72/0x450132973bff32a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.075758:0:14382:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787786533.075762:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000419240ff/0x450132973bff32ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.075769:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7200 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:0.0:1787786533.075772:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000419240ff/0x450132973bff32ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.075779:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000419240ff/0x450132973bff32ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.075822:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000419240ff/0x450132973bff32ac lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.075830:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000419240ff/0x450132973bff32ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.075845:0:14382:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787786533.075848:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1ff83e5/0x450132973bff32b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.075855:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb6c00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:0.0:1787786533.075864:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1ff83e5/0x450132973bff32b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.075873:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1ff83e5/0x450132973bff32b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.075885:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1ff83e5/0x450132973bff32b3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.075892:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1ff83e5/0x450132973bff32b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.075907:0:14382:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787786533.075911:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000039328e0f/0x450132973bff32ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.075918:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb6600 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:0.0:1787786533.075921:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000039328e0f/0x450132973bff32ba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.075928:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000039328e0f/0x450132973bff32ba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.075939:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000039328e0f/0x450132973bff32ba lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.075945:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000039328e0f/0x450132973bff32ba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.075964:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786533.075966:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786533.075968:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786533.076116:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786533.076601:0:15614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d0b4ad8/0x450132973bff32c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.076720:0:15614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787786533.077357:0:15614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787786533.077364:0:15614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c148c1f/0x450132973bff32c8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.077378:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787786533.077382:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787786533.077387:0:15614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c148c1f/0x450132973bff32c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.077399:0:15614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c148c1f/0x450132973bff32c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.077407:0:15614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c148c1f/0x450132973bff32c8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.077415:0:15614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c148c1f/0x450132973bff32c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.077540:0:14382:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787786533.077549:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d0b4ad8/0x450132973bff32c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.077557:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7c00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:0.0:1787786533.077561:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d0b4ad8/0x450132973bff32c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.077569:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d0b4ad8/0x450132973bff32c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.077584:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d0b4ad8/0x450132973bff32c1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.077592:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d0b4ad8/0x450132973bff32c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.077611:0:14382:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787786533.077614:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c148c1f/0x450132973bff32c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.077621:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb6e00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:0.0:1787786533.077631:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c148c1f/0x450132973bff32c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.077712:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c148c1f/0x450132973bff32c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.077724:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c148c1f/0x450132973bff32c8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.077734:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786533.077735:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786533.077737:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786533.077891:0:15614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787786533.077896:0:15614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c148c1f/0x450132973bff32c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787786533.078389:0:15614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787786533.078395:0:15614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfd91582/0x450132973bff32cf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.078412:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787786533.078416:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787786533.078420:0:15614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfd91582/0x450132973bff32cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.078431:0:15614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfd91582/0x450132973bff32cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.078439:0:15614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfd91582/0x450132973bff32cf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.078446:0:15614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfd91582/0x450132973bff32cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786533.078484:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787786533.078492:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfd91582/0x450132973bff32cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786533.078499:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb6400 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:1.0:1787786533.078503:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfd91582/0x450132973bff32cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786533.078511:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfd91582/0x450132973bff32cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786533.078526:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfd91582/0x450132973bff32cf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.078623:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786533.078626:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786533.078628:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786533.078752:0:15614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787786533.078759:0:15614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfd91582/0x450132973bff32cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787786533.079271:0:15614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787786533.079278:0:15614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003eba6a47/0x450132973bff32d6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.079288:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=459s v=(0 0) 00010000:00010000:3.0:1787786533.079292:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787786533.079297:0:15614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003eba6a47/0x450132973bff32d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.079320:0:15614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003eba6a47/0x450132973bff32d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.079328:0:15614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003eba6a47/0x450132973bff32d6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.079335:0:15614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003eba6a47/0x450132973bff32d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.082024:0:14382:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787786533.082040:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003eba6a47/0x450132973bff32d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.082054:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7400 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:0.0:1787786533.082188:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003eba6a47/0x450132973bff32d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.082203:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003eba6a47/0x450132973bff32d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.082230:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003eba6a47/0x450132973bff32d6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.082678:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786533.082681:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786533.082683:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786533.084857:0:15614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787786533.084872:0:15614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003eba6a47/0x450132973bff32d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786533.086397:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787786533.086998:0:15614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787786533.087008:0:15614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021cd2b12/0x450132973bff32dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.087025:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1787786533.087030:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787786533.087037:0:15614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000021cd2b12/0x450132973bff32dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.087051:0:15614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000021cd2b12/0x450132973bff32dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.087060:0:15614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000021cd2b12/0x450132973bff32dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.087136:0:15614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000021cd2b12/0x450132973bff32dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.087174:0:15614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787786533.087956:0:15614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787786533.087964:0:15614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea7658ee/0x450132973bff32e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.087981:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1787786533.087984:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787786533.087989:0:15614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea7658ee/0x450132973bff32e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.088000:0:15614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea7658ee/0x450132973bff32e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.088008:0:15614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea7658ee/0x450132973bff32e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.088015:0:15614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea7658ee/0x450132973bff32e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.088035:0:15614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787786533.088223:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787786533.088232:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000021cd2b12/0x450132973bff32dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.088242:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aac600 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:3.0:1787786533.088248:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000021cd2b12/0x450132973bff32dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.088258:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000021cd2b12/0x450132973bff32dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.088277:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000021cd2b12/0x450132973bff32dd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.088293:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000021cd2b12/0x450132973bff32dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.088311:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787786533.088315:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea7658ee/0x450132973bff32e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.088322:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aace00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:3.0:1787786533.088325:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea7658ee/0x450132973bff32e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.088333:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea7658ee/0x450132973bff32e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.088344:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea7658ee/0x450132973bff32e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.088350:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea7658ee/0x450132973bff32e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.088362:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786533.088364:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786533.088365:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786533.088461:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787786533.088764:0:15614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787786533.088771:0:15614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa99027c/0x450132973bff32eb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.088780:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1787786533.088783:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787786533.088787:0:15614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa99027c/0x450132973bff32eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.088817:0:15614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa99027c/0x450132973bff32eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.088836:0:15614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fa99027c/0x450132973bff32eb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.088934:0:15614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fa99027c/0x450132973bff32eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.088960:0:15614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787786533.088978:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787786533.088985:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fa99027c/0x450132973bff32eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.088999:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aada00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:3.0:1787786533.089002:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa99027c/0x450132973bff32eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.089010:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fa99027c/0x450132973bff32eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.089022:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fa99027c/0x450132973bff32eb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.089029:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa99027c/0x450132973bff32eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.089048:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786533.089051:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786533.089053:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787786533.089775:0:15614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787786533.089782:0:15614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cf621a0/0x450132973bff32f2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.090765:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1787786533.090770:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787786533.090778:0:15614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cf621a0/0x450132973bff32f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.090841:0:15614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cf621a0/0x450132973bff32f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.090852:0:15614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cf621a0/0x450132973bff32f2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.090860:0:15614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cf621a0/0x450132973bff32f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.090897:0:15614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787786533.091423:0:15614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787786533.091430:0:15614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015649b8c/0x450132973bff32f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.091440:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1787786533.091443:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787786533.091448:0:15614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015649b8c/0x450132973bff32f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.091457:0:15614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015649b8c/0x450132973bff32f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.091465:0:15614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015649b8c/0x450132973bff32f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.091472:0:15614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015649b8c/0x450132973bff32f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.091721:0:15614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787786533.091779:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787786533.091801:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cf621a0/0x450132973bff32f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.091812:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aaca00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:3.0:1787786533.091816:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cf621a0/0x450132973bff32f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.091825:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cf621a0/0x450132973bff32f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.091849:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cf621a0/0x450132973bff32f2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.091862:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cf621a0/0x450132973bff32f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.091882:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787786533.091886:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015649b8c/0x450132973bff32f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.091893:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aac200 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:3.0:1787786533.091898:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015649b8c/0x450132973bff32f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.091906:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015649b8c/0x450132973bff32f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.091917:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015649b8c/0x450132973bff32f9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.091925:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015649b8c/0x450132973bff32f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.091938:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786533.091941:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786533.091950:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786533.092017:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787786533.093044:0:15614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787786533.093054:0:15614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee834293/0x450132973bff3300 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.093133:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1787786533.093161:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787786533.093168:0:15614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee834293/0x450132973bff3300 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.093182:0:15614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee834293/0x450132973bff3300 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.093192:0:15614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee834293/0x450132973bff3300 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.093199:0:15614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee834293/0x450132973bff3300 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.093225:0:15614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787786533.093899:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787786533.093908:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee834293/0x450132973bff3300 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.093919:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aad200 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:3.0:1787786533.093924:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee834293/0x450132973bff3300 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.093933:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee834293/0x450132973bff3300 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.093952:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee834293/0x450132973bff3300 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.093960:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee834293/0x450132973bff3300 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.093982:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786533.093984:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786533.093986:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787786533.094224:0:15614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787786533.094242:0:15614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000747a79e/0x450132973bff3307 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.094253:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1787786533.094257:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787786533.094263:0:15614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000747a79e/0x450132973bff3307 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.094274:0:15614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000747a79e/0x450132973bff3307 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.094478:0:15614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000747a79e/0x450132973bff3307 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.094493:0:15614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000747a79e/0x450132973bff3307 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.094519:0:15614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787786533.094771:0:14382:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787786533.094778:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000747a79e/0x450132973bff3307 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.094786:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aadc00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:3.0:1787786533.094813:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000747a79e/0x450132973bff3307 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.094837:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000747a79e/0x450132973bff3307 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.094850:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000747a79e/0x450132973bff3307 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.094856:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000747a79e/0x450132973bff3307 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.094872:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786533.094874:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786533.094876:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787786533.095255:0:15614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787786533.095262:0:15614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e70066b7/0x450132973bff330e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.095272:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1787786533.095276:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787786533.095471:0:15614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e70066b7/0x450132973bff330e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.095484:0:15614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e70066b7/0x450132973bff330e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.095493:0:15614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e70066b7/0x450132973bff330e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.095501:0:15614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e70066b7/0x450132973bff330e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.095524:0:15614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787786533.095825:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787786533.095831:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e70066b7/0x450132973bff330e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.095840:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b5237aad600 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:3.0:1787786533.095843:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e70066b7/0x450132973bff330e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.095851:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e70066b7/0x450132973bff330e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.095865:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e70066b7/0x450132973bff330e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.095885:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e70066b7/0x450132973bff330e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.095903:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786533.095905:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786533.095907:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787786533.096467:0:15614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787786533.096476:0:15614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002509f5d5/0x450132973bff3315 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.096490:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1787786533.096493:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787786533.096497:0:15614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002509f5d5/0x450132973bff3315 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.096506:0:15614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002509f5d5/0x450132973bff3315 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.096514:0:15614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002509f5d5/0x450132973bff3315 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.096521:0:15614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002509f5d5/0x450132973bff3315 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.096545:0:15614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787786533.096643:0:14382:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787786533.096650:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002509f5d5/0x450132973bff3315 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.096660:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523d7a9400 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:3.0:1787786533.096664:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002509f5d5/0x450132973bff3315 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.096683:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002509f5d5/0x450132973bff3315 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.096696:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002509f5d5/0x450132973bff3315 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.096703:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002509f5d5/0x450132973bff3315 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.096724:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786533.096726:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786533.096727:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787786533.097007:0:15614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787786533.097014:0:15614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000508f0b9c/0x450132973bff331c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.097023:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1787786533.097027:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787786533.097031:0:15614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000508f0b9c/0x450132973bff331c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.097040:0:15614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000508f0b9c/0x450132973bff331c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.097056:0:15614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000508f0b9c/0x450132973bff331c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.097572:0:15614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000508f0b9c/0x450132973bff331c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.097592:0:15614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787786533.098300:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787786533.098308:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000508f0b9c/0x450132973bff331c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.098318:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523d7a8a00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:3.0:1787786533.098323:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000508f0b9c/0x450132973bff331c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.098332:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000508f0b9c/0x450132973bff331c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.098350:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000508f0b9c/0x450132973bff331c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.098357:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000508f0b9c/0x450132973bff331c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.098379:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786533.098382:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786533.098384:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787786533.098543:0:15614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787786533.098551:0:15614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001808b9b8/0x450132973bff3323 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.098562:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1787786533.098565:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787786533.098569:0:15614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001808b9b8/0x450132973bff3323 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.098580:0:15614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001808b9b8/0x450132973bff3323 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.098589:0:15614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001808b9b8/0x450132973bff3323 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.098597:0:15614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001808b9b8/0x450132973bff3323 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.098719:0:15614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787786533.099176:0:15614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787786533.099182:0:15614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a0c6afa/0x450132973bff332a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.099191:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1787786533.099194:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787786533.099198:0:15614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a0c6afa/0x450132973bff332a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.099207:0:15614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a0c6afa/0x450132973bff332a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.099215:0:15614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a0c6afa/0x450132973bff332a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.099222:0:15614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a0c6afa/0x450132973bff332a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.099775:0:14382:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787786533.099783:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001808b9b8/0x450132973bff3323 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.099802:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523d7a8200 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:3.0:1787786533.099806:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001808b9b8/0x450132973bff3323 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.099827:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001808b9b8/0x450132973bff3323 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.099841:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001808b9b8/0x450132973bff3323 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.099859:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001808b9b8/0x450132973bff3323 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.099875:0:14382:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787786533.099879:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a0c6afa/0x450132973bff332a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.099885:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523d7a9000 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:3.0:1787786533.099888:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a0c6afa/0x450132973bff332a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.099895:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a0c6afa/0x450132973bff332a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.099904:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a0c6afa/0x450132973bff332a lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.099912:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786533.099913:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786533.099921:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786533.100086:0:15614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787786533.100092:0:15614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a0c6afa/0x450132973bff332a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.102894:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787786533.111433:0:15614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787786533.111447:0:15614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000562f83b2/0x450132973bff3331 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.111469:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1787786533.111474:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787786533.111482:0:15614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000562f83b2/0x450132973bff3331 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.111497:0:15614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000562f83b2/0x450132973bff3331 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.111507:0:15614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000562f83b2/0x450132973bff3331 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.111516:0:15614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000562f83b2/0x450132973bff3331 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.111581:0:15614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787786533.112217:0:15614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787786533.112223:0:15614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2af2762/0x450132973bff3338 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.112244:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1787786533.112249:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787786533.112253:0:15614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2af2762/0x450132973bff3338 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.112263:0:15614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2af2762/0x450132973bff3338 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.112350:0:15614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2af2762/0x450132973bff3338 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.112358:0:15614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2af2762/0x450132973bff3338 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.112526:0:14382:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787786533.112535:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000562f83b2/0x450132973bff3331 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.112545:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523d7a9e00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:3.0:1787786533.112551:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000562f83b2/0x450132973bff3331 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.112561:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000562f83b2/0x450132973bff3331 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.112578:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000562f83b2/0x450132973bff3331 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.112586:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000562f83b2/0x450132973bff3331 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.113055:0:14382:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787786533.113139:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2af2762/0x450132973bff3338 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.113159:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523d7a8800 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:3.0:1787786533.113164:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2af2762/0x450132973bff3338 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.113184:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2af2762/0x450132973bff3338 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.113196:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2af2762/0x450132973bff3338 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.113206:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786533.113208:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786533.113210:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786533.113428:0:15614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787786533.113434:0:15614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2af2762/0x450132973bff3338 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787786533.114463:0:15614:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787786533.114474:0:15614:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019640e47/0x450132973bff333f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.114487:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1787786533.114491:0:15614:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787786533.114497:0:15614:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019640e47/0x450132973bff333f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.114509:0:15614:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019640e47/0x450132973bff333f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.114519:0:15614:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019640e47/0x450132973bff333f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786533.114538:0:15614:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019640e47/0x450132973bff333f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.114692:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787786533.114698:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019640e47/0x450132973bff333f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.114706:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523d7a9600 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:3.0:1787786533.114711:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019640e47/0x450132973bff333f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.114720:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019640e47/0x450132973bff333f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.114734:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019640e47/0x450132973bff333f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786533.114743:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786533.114744:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787786533.114746:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786533.115244:0:15614:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787786533.115251:0:15614:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019640e47/0x450132973bff333f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15614 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1787786533.115595:0:15614:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:2.0:1787786533.115705:0:15614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5233339a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14416:x1874629686816896:12345-0@lo:5:osp-pre-0-0.0 Request processed in 99739us (100924us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786533.115716:0:15614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787786533.115772:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52333383c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14416:1874629686816896:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1787786533.115806:0:14416:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1787786533.115854:0:14416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52333383c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14416:1874629686817024:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787786533.115888:0:14416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786533.115928:0:14416:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b522cc57c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787786533.115946:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686817024 00000100:00100000:2.0:1787786533.115953:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686817024 00000100:00100000:2.0:1787786533.116006:0:15080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787786533.116014:0:15080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5233338780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14416:x1874629686817024:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1787786533.116052:0:15080:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:3.0:1787786533.119061:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786533.123827:0:15080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5233338780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14416:x1874629686817024:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7806us (7931us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787786533.123842:0:15080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787786533.124008:0:14416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52333383c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14416:1874629686817024:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1787786533.124026:0:14416:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1787786533.260459:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786534.282504:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786535.310941:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787786536.176507:0:15795:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787786536.176512:0:15795:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1787786536.177133:0:15795:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8b52329a4000 00000020:01000004:0.0:1787786536.177149:0:15795:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787786536.177161:0:15795:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1787786536.177349:0:15795:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8b51010cb370) 00000020:00000080:0.0:1787786536.177369:0:15795:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787786536.199923:0:15795:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787786536.200441:0:15795:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1787786536.202104:0:15795:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787786536.202497:0:15795:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1787786536.202746:0:15795:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1787786536.203725:0:15795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 553: rc = 0 00100000:10000000:1.0:1787786536.203917:0:15795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 553: rc = 0 00100000:10000000:1.0:1787786536.204075:0:15795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 553: rc = 0 00100000:10000000:1.0:1787786536.204972:0:15795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 455: rc = 0 00100000:10000000:1.0:1787786536.205412:0:15795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 455: rc = 0 00100000:10000000:1.0:1787786536.206411:0:15795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 455: rc = 0 00100000:10000000:1.0:1787786536.206905:0:15795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 455: rc = 0 00100000:10000000:1.0:1787786536.207315:0:15795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 455: rc = 0 00100000:10000000:1.0:1787786536.207713:0:15795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 455: rc = 0 00000020:00000080:1.0:1787786536.209061:0:15795:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1787786536.209074:0:15795:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787786536.209099:0:15795:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x450132973bff334d 00000020:01000004:1.0:1787786536.209108:0:15795:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1787786536.209133:0:15795:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.134@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787786536.209138:0:15795:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787786536.209145:0:15795:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1787786536.209303:0:15795:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1787786536.209308:0:15795:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.134@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1787786536.221533:0:15795:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.134@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787786536.221642:0:15795:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.134@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1787786536.221647:0:15795:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787786536.221649:0:15795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787786536.221650:0:15795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787786536.221651:0:15795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787786536.221653:0:15795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787786536.221654:0:15795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787786536.221655:0:15795:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787786536.221657:0:15795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787786536.221658:0:15795:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787786536.221662:0:15795:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1787786536.221665:0:15795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787786536.221666:0:15795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787786536.221667:0:15795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787786536.221668:0:15795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787786536.221669:0:15795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787786536.221670:0:15795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787786536.221671:0:15795:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787786536.221672:0:15795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787786536.221673:0:15795:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787786536.221701:0:15795:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787786536.221721:0:15795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103291a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686817152:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787786536.222056:0:15795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786536.222190:0:15795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5206fd30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787786536.222387:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686817152 00000100:00100000:1.0:1787786536.222395:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686817152 00000100:00100000:1.0:1787786536.222459:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787786536.222468:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52329ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+16:15795:x1874629686817152:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787786536.222511:0:14388:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787786536.222515:0:14388:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1787786536.222519:0:14388:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1787786536.233677:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52329ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+16:15795:x1874629686817152:12345-0@lo:253:mount.lustre.0 Request processed in 11199us (11610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786536.233692:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787786536.233853:0:15795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103291a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686817152:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787786536.233870:0:15795:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787786536.233874:0:15795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787786536.233875:0:15795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787786536.233876:0:15795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787786536.233878:0:15795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787786536.233879:0:15795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787786536.233880:0:15795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787786536.233882:0:15795:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787786536.233883:0:15795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787786536.233885:0:15795:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787786536.233905:0:15795:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8b52329a4000 from lustre-OST0001 10000000:01000000:0.0:1787786536.233934:0:15795:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1787786536.233937:0:15795:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787786536.233944:0:15795:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8b5209123370 local copy 00010000:00010000:0.0:1787786536.233955:0:15795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523b4d9400/0x450132973bff30fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff3101 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786536.234385:0:15795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103291a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686817280:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787786536.234421:0:15795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786536.234502:0:15795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5206fd3240 going to sleep for 11 seconds 00000100:00100000:3.0:1787786536.234536:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686817280 00000100:00100000:3.0:1787786536.234542:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686817280 00000100:00100000:3.0:1787786536.234620:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787786536.234630:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52329aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+16:15795:x1874629686817280:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787786536.235018:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52329aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+16:15795:x1874629686817280:12345-0@lo:501:mount.lustre.0 Request processed in 389us (595us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787786536.235025:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787786536.235097:0:15795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103291a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686817280:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787786536.235110:0:15795:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787786536.235263:0:15795:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787786536.235270:0:15795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523b4d9400/0x450132973bff30fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff3101 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786536.235278:0:15795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b523b4d9400/0x450132973bff30fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff3101 expref: -99 pid: 14375 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787786536.235299:0:15795:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8b52329a4000 10000000:01000000:1.0:1787786536.235303:0:15795:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787786536.235307:0:15795:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787786536.235309:0:15795:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787786536.235313:0:15795:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1787786536.235315:0:15795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1787786536.235335:0:15795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523b4d8800/0x450132973bff3354 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786536.235342:0:15795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b523b4d8800/0x450132973bff3354 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786536.235359:0:15795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b523b4d8800/0x450132973bff3354 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786536.235371:0:15795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686817408:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787786536.235395:0:15795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786536.235758:0:15795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52304be780 going to sleep for 11 seconds 00000100:00100000:0.0:1787786536.235894:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686817408 00000100:00100000:0.0:1787786536.235899:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686817408 00000100:00100000:0.0:1787786536.235926:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787786536.235935:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52329ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+16:15795:x1874629686817408:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787786536.235945:0:14386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786536.235957:0:14386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b520912d000/0x450132973bff335b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff3354 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786536.235984:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b520912d000/0x450132973bff335b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff3354 expref: 17 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786536.236004:0:14386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b520912d000/0x450132973bff335b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff3354 expref: 17 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786536.236013:0:14386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912d000, rc 0) 00000100:00100000:0.0:1787786536.236047:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52329ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+17:15795:x1874629686817408:12345-0@lo:101:mount.lustre.0 Request processed in 109us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786536.236053:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787786536.236153:0:15795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686817408:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787786536.236284:0:15795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b523b4d8800/0x450132973bff3354 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff335b expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786536.236294:0:15795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b523b4d8800/0x450132973bff3354 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff335b expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787786536.237030:0:15795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1787786536.238125:0:15795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787786536.238938:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1787786536.238990:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1787786536.239025:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1787786536.239073:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1787786536.239124:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787786536.239155:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787786536.239224:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787786536.239233:0:15795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787786536.239329:0:15795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686817536:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787786536.239395:0:15795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786536.239444:0:15795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52304be480 going to sleep for 11 seconds 00000100:00100000:3.0:1787786536.239638:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686817536 00000100:00100000:3.0:1787786536.239646:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686817536 00000100:00100000:3.0:1787786536.239700:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787786536.239715:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52329a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+17:15795:x1874629686817536:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787786536.240275:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52329a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+17:15795:x1874629686817536:12345-0@lo:501:mount.lustre.0 Request processed in 566us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786536.240285:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787786536.242363:0:15795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686817536:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787786536.242434:0:15795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686817664:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787786536.242499:0:15795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786536.242530:0:15795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52304be480 going to sleep for 11 seconds 00000100:00100000:0.0:1787786536.242598:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686817664 00000100:00100000:0.0:1787786536.242606:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686817664 00000100:00100000:0.0:1787786536.242657:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787786536.242666:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52329aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+17:15795:x1874629686817664:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787786536.243042:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52329aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+17:15795:x1874629686817664:12345-0@lo:503:mount.lustre.0 Request processed in 376us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786536.243049:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787786536.243159:0:15795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686817664:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787786536.243868:0:15795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787786536.243935:0:15795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686817792:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787786536.243984:0:15795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786536.244024:0:15795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52304be480 going to sleep for 11 seconds 00000100:00100000:3.0:1787786536.244198:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686817792 00000100:00100000:3.0:1787786536.244205:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686817792 00000100:00100000:3.0:1787786536.244249:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787786536.244259:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52329aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+17:15795:x1874629686817792:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787786536.244448:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52329aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+17:15795:x1874629686817792:12345-0@lo:502:mount.lustre.0 Request processed in 189us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786536.244456:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787786536.244592:0:15795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686817792:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787786536.244955:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787786536.245003:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787786536.245033:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787786536.245077:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787786536.245125:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787786536.245157:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787786536.245200:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787786536.245237:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787786536.245283:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1787786536.245313:0:15795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686817920:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787786536.245357:0:15795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786536.245434:0:15795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52304be480 going to sleep for 11 seconds 00000100:00100000:0.0:1787786536.248606:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686817920 00000100:00100000:0.0:1787786536.248621:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686817920 00000100:00100000:0.0:1787786536.248688:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787786536.248698:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52329a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+17:15795:x1874629686817920:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787786536.248972:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52329a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+17:15795:x1874629686817920:12345-0@lo:502:mount.lustre.0 Request processed in 275us (3613us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786536.248980:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787786536.249083:0:15795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686817920:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787786536.249198:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1787786536.249219:0:15795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1787786536.251533:0:15797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787786536.251550:0:15797:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787786536.251557:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787786536.251560:0:15797:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787786536.251567:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787786536.251582:0:15797:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8b52090acd28) 00000020:00000080:3.0:1787786536.251605:0:15797:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787786536.251611:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787786536.251668:0:15797:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b52329a4000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787786536.251677:0:15797:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787786536.251867:0:15797:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x450132973bff3369 00010000:00010000:3.0:1787786536.261963:0:15797:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1787786536.262414:0:15797:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1787786536.269996:0:15797:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1787786536.271551:0:15797:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1787786536.271562:0:15797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787786536.271568:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786536.271570:0:15797:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1787786536.271575:0:15797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787786536.271580:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786536.271581:0:15797:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787786536.271585:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787786536.271587:0:15797:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787786536.271589:0:15797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787786536.271591:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786536.271592:0:15797:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787786536.271594:0:15797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787786536.271596:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786536.271597:0:15797:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787786536.271600:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1787786536.271655:0:15797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787786536.271659:0:15797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787786536.271661:0:15797:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787786536.271664:0:15797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1787786536.272961:0:15795:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1787786536.272998:0:15795:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787786536.273029:0:15795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523b4d8800/0x450132973bff3354 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff335b expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786536.273042:0:15795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b523b4d8800/0x450132973bff3354 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff335b expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787786536.273049:0:15795:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b52329a4000 from 1 10000000:01000000:1.0:1787786536.273052:0:15795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787786536.273100:0:15795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523b4d8200/0x450132973bff3370 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786536.273107:0:15795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b523b4d8200/0x450132973bff3370 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786536.273117:0:15795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b523b4d8200/0x450132973bff3370 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786536.273141:0:15795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686818048:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787786536.273208:0:15795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786536.273257:0:15795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52304be480 going to sleep for 11 seconds 00000100:00100000:3.0:1787786536.273366:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686818048 00000100:00100000:3.0:1787786536.273374:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686818048 00000100:00100000:3.0:1787786536.273422:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787786536.273431:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52329abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+17:15795:x1874629686818048:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787786536.273445:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786536.273458:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b523bcb6400/0x450132973bff3377 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff3370 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786536.273481:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b523bcb6400/0x450132973bff3377 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff3370 expref: 18 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786536.273490:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b523bcb6400/0x450132973bff3377 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff3370 expref: 18 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786536.273498:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb6400, rc 0) 00000100:00100000:3.0:1787786536.273543:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52329abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+18:15795:x1874629686818048:12345-0@lo:101:mount.lustre.0 Request processed in 113us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786536.273561:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787786536.273674:0:15795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686818048:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787786536.273687:0:15795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b523b4d8200/0x450132973bff3370 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff3377 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786536.273697:0:15795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b523b4d8200/0x450132973bff3370 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff3377 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787786536.274289:0:15795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787786536.274582:0:15795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787786536.274859:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787786536.274914:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787786536.274993:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787786536.275001:0:15795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787786536.275063:0:15795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686818176:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787786536.275125:0:15795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786536.275151:0:15795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52304be480 going to sleep for 11 seconds 00000100:00100000:3.0:1787786536.275274:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686818176 00000100:00100000:3.0:1787786536.275280:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686818176 00000100:00100000:3.0:1787786536.275317:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787786536.275327:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52329a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+18:15795:x1874629686818176:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787786536.275523:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52329a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+18:15795:x1874629686818176:12345-0@lo:501:mount.lustre.0 Request processed in 197us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786536.275532:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787786536.275663:0:15795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686818176:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787786536.275691:0:15795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686818304:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787786536.275726:0:15795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786536.275819:0:15795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52304be480 going to sleep for 11 seconds 00000100:00100000:0.0:1787786536.278567:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686818304 00000100:00100000:0.0:1787786536.278674:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686818304 00000100:00100000:0.0:1787786536.278734:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787786536.278744:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52329a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+18:15795:x1874629686818304:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787786536.284438:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52329a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+18:15795:x1874629686818304:12345-0@lo:503:mount.lustre.0 Request processed in 5687us (8701us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786536.284462:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787786536.286782:0:15795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686818304:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787786536.287883:0:15795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787786536.287977:0:15795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686818432:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787786536.289849:0:15795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786536.291206:0:15795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52304be480 going to sleep for 11 seconds 00000100:00100000:3.0:1787786536.296412:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686818432 00000100:00100000:3.0:1787786536.296427:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686818432 00000100:00100000:2.0:1787786536.298403:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787786536.298420:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523289d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+18:15795:x1874629686818432:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787786536.298873:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523289d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+18:15795:x1874629686818432:12345-0@lo:502:mount.lustre.0 Request processed in 457us (9028us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786536.298883:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787786536.299334:0:15795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686818432:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787786536.300005:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787786536.300066:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787786536.300135:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787786536.300319:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787786536.300430:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787786536.300483:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787786536.300521:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787786536.300557:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787786536.300674:0:15795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686818560:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787786536.301135:0:15795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786536.301369:0:15795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52304be480 going to sleep for 11 seconds 00000100:00100000:0.0:1787786536.301414:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686818560 00000100:00100000:0.0:1787786536.301423:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686818560 00000100:00100000:0.0:1787786536.301513:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787786536.301523:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523289d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+18:15795:x1874629686818560:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787786536.301818:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523289d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+18:15795:x1874629686818560:12345-0@lo:502:mount.lustre.0 Request processed in 268us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786536.301827:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787786536.301927:0:15795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c08000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686818560:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787786536.302046:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787786536.302059:0:15795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1787786536.303230:0:15801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787786536.303243:0:15801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787786536.303245:0:15801:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787786536.303253:0:15801:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b52329a4000 00000020:00000080:1.0:1787786536.303256:0:15801:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787786536.303263:0:15801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787786536.303266:0:15801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787786536.303267:0:15801:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787786536.303270:0:15801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787786536.303272:0:15801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787786536.303273:0:15801:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787786536.303277:0:15801:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8b52329a4000 00000020:00000080:1.0:1787786536.303279:0:15801:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787786536.303343:0:15801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787786536.303347:0:15801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787786536.303349:0:15801:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787786536.303351:0:15801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787786536.303353:0:15801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787786536.303354:0:15801:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787786536.303358:0:15801:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8b52329a4000 00000020:00000080:1.0:1787786536.303360:0:15801:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787786536.303394:0:15801:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787786536.303398:0:15801:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787786536.303400:0:15801:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787786536.303403:0:15801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1787786536.310909:0:15795:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1787786536.310953:0:15795:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787786536.310977:0:15795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523b4d8200/0x450132973bff3370 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff3377 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786536.310991:0:15795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b523b4d8200/0x450132973bff3370 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff3377 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786536.311060:0:15795:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787786536.311064:0:15795:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8b52329a4000 10000000:01000000:3.0:1787786536.311068:0:15795:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8b52329a4000 10000000:01000000:3.0:1787786536.311073:0:15795:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787786536.311080:0:15795:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8b52329a4000 from 1 10000000:01000000:3.0:1787786536.311093:0:15795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787786536.311135:0:15795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7400/0x450132973bff337e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786536.311145:0:15795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7400/0x450132973bff337e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786536.311179:0:15795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7400/0x450132973bff337e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786536.311211:0:15795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686818688:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787786536.311283:0:15795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786536.311327:0:15795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5202c719c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787786536.311998:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686818688 00000100:00100000:3.0:1787786536.312007:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686818688 00000100:00100000:3.0:1787786536.312317:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787786536.312327:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523289c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+18:15795:x1874629686818688:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787786536.312343:0:14385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786536.312360:0:14385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b523bcb6e00/0x450132973bff3385 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff337e expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786536.312386:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b523bcb6e00/0x450132973bff3385 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff337e expref: 19 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786536.312399:0:14385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b523bcb6e00/0x450132973bff3385 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff337e expref: 19 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786536.312408:0:14385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb6e00, rc 0) 00000100:00100000:3.0:1787786536.312465:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523289c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+19:15795:x1874629686818688:12345-0@lo:101:mount.lustre.0 Request processed in 139us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786536.312473:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787786536.312543:0:15795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686818688:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787786536.312562:0:15795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7400/0x450132973bff337e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff3385 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786536.313560:0:15795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7400/0x450132973bff337e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff3385 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787786536.315537:0:15795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1787786536.315901:0:15795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787786536.316439:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1787786536.316487:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1787786536.316523:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1787786536.316882:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1787786536.316927:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1787786536.316979:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1787786536.317017:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1787786536.317223:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1787786536.317281:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1787786536.317320:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1787786536.317357:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1787786536.317431:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1787786536.317471:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1787786536.317507:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1787786536.317557:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1787786536.317744:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1787786536.317917:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1787786536.317974:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1787786536.318026:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1787786536.318151:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1787786536.318272:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1787786536.318307:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1787786536.318335:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1787786536.318376:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1787786536.318406:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1787786536.318434:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1787786536.318492:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1787786536.318528:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1787786536.318564:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1787786536.318937:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1787786536.318972:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1787786536.319020:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1787786536.319908:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1787786536.319975:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1787786536.320011:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1787786536.320071:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1787786536.320120:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1787786536.320222:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1787786536.320231:0:15795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1787786536.320354:0:15795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686818816:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787786536.320436:0:15795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786536.320497:0:15795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5202c719c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787786536.320599:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686818816 00000100:00100000:0.0:1787786536.320606:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686818816 00000100:00100000:0.0:1787786536.320646:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1787786536.320656:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523289c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+19:15795:x1874629686818816:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787786536.320923:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523289c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+19:15795:x1874629686818816:12345-0@lo:501:mount.lustre.0 Request processed in 266us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786536.320931:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787786536.322985:0:15795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d4780 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686818816:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787786536.323061:0:15795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523333b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686818944:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787786536.323148:0:15795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786536.323192:0:15795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52328bd000 going to sleep for 11 seconds 00000100:00100000:3.0:1787786536.323428:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686818944 00000100:00100000:3.0:1787786536.323437:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686818944 00000100:00100000:3.0:1787786536.323485:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787786536.323494:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523289ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+19:15795:x1874629686818944:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787786536.323813:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523289ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+19:15795:x1874629686818944:12345-0@lo:503:mount.lustre.0 Request processed in 294us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786536.323823:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787786536.323998:0:15795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523333b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686818944:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787786536.324760:0:15795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787786536.324874:0:15795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523333b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686819072:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787786536.324925:0:15795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786536.324951:0:15795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52328bd000 going to sleep for 11 seconds 00000100:00100000:3.0:1787786536.325021:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686819072 00000100:00100000:3.0:1787786536.325027:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686819072 00000100:00100000:3.0:1787786536.325066:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787786536.325075:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523289e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+19:15795:x1874629686819072:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787786536.325340:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523289e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+19:15795:x1874629686819072:12345-0@lo:502:mount.lustre.0 Request processed in 265us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786536.325356:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787786536.325460:0:15795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523333b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686819072:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787786536.325701:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1787786536.325750:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1787786536.325785:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1787786536.325873:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1787786536.325912:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1787786536.325958:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1787786536.325995:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1787786536.326029:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1787786536.326106:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1787786536.326146:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1787786536.326178:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1787786536.326225:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1787786536.326263:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1787786536.326294:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1787786536.326336:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1787786536.326385:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1787786536.326412:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1787786536.326451:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1787786536.326485:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1787786536.326519:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1787786536.326567:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1787786536.326604:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1787786536.326641:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1787786536.326719:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1787786536.326762:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1787786536.326829:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1787786536.326891:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1787786536.326927:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1787786536.326957:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1787786536.326998:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1787786536.327030:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1787786536.329343:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787786536.336694:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787786536.336812:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787786536.336852:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787786536.336899:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787786536.336935:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787786536.336971:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787786536.337015:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787786536.337051:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787786536.337115:0:15795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686819200:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787786536.337210:0:15795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786536.337249:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686819200 00000100:00100000:3.0:1787786536.337257:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686819200 00000100:00100000:3.0:1787786536.337299:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787786536.337309:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523289f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+19:15795:x1874629686819200:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787786536.337524:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523289f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+19:15795:x1874629686819200:12345-0@lo:502:mount.lustre.0 Request processed in 215us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786536.337533:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787786536.337590:0:15795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5202af8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787786536.337613:0:15795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d4b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686819200:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787786536.337680:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1787786536.337689:0:15795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00010000:00010000:0.0:1787786536.338282:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787786536.347781:0:15806:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1787786536.347818:0:15806:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8b5209120000) 00000020:00000080:1.0:1787786536.347840:0:15806:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1787786536.347919:0:15806:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8b52329a4000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787786536.347923:0:15806:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8b52329a4000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1787786536.347926:0:15806:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8b52329a4000 3 00010000:00080000:1.0:1787786536.347958:0:15806:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8b52329a0800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.134@tcp at head 00010000:00010000:1.0:1787786536.349611:0:15806:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1787786536.351612:0:15806:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787786536.351652:0:15806:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787786536.351665:0:15806:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x450132973bff3393 00000100:00080000:1.0:1787786536.351676:0:15806:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787786536.351683:0:15806:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8b52329a0800 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:1.0:1787786536.351720:0:15806:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5237c08000 x1874629686819328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787786536.351782:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874629686819328:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787786536.351875:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787786536.354183:0:15806:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787786536.356260:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686819328 00000100:00100000:2.0:1787786536.356273:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686819328 00000100:00100000:2.0:1787786536.356320:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787786536.356328:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523333b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1874629686819328:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787786536.356356:0:14395:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:2.0:1787786536.356393:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x450132973bff339a 00000004:00100000:2.0:1787786536.356410:0:14395:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787786536.356446:0:14395:0:(import.c:65:import_set_state_nolock()) ffff8b523d2c1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787786536.356529:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523333b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874629686819328:12345-0@lo:38:llog_process_th.0 Request processed in 200us (4653us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786536.356537:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787786536.356654:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5237c08000 x1874629686819328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787786546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786536.356666:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787786536.356675:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1787786536.356683:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787786536.356687:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787786536.356700:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b52329a0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787786536.356707:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1874629686819328:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787786536.356927:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:3.0:1787786536.356982:0:12641:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787786536.356987:0:12641:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787786536.356989:0:12641:0:(import.c:65:import_set_state_nolock()) ffff8b52117ba000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787786536.356994:0:12641:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 459 00000100:00080000:3.0:1787786536.357005:0:12641:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1787786536.357009:0:12641:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8b52117ba000 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:3.0:1787786536.357030:0:12641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b523b4d4780 x1874629686819584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787786536.357113:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686819712:0@lo:400:kworker.0 00000100:00100000:3.0:1787786536.357153:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786536.357180:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787786536.357186:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686819840:0@lo:400:kworker.0 00000100:00100000:3.0:1787786536.357208:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786536.357236:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686819712 00000100:00100000:3.0:1787786536.357241:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686819712 00000100:00100000:3.0:1787786536.357268:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686819840 00000100:00100000:3.0:1787786536.357270:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686819840 00000100:00100000:3.0:1787786536.357299:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787786536.357307:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686819712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786536.357346:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686819712:12345-0@lo:400:kworker.0 Request processed in 41us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786536.357353:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787786536.357365:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787786536.357371:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686819840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786536.357414:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686819840:12345-0@lo:400:kworker.0 Request processed in 43us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786536.357419:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1787786536.357439:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787786536.357460:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523b4d7c00 x1874629686819840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787786552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786536.357481:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686819840:0@lo:400:kworker.0 00010000:00080000:3.0:1787786536.357493:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523b4d5680 x1874629686819712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787786552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786536.357500:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686819712:0@lo:400:kworker.0 00000100:00100000:2.0:1787786536.358885:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874629686819584:0@lo:8:kworker.0 00000100:00100000:2.0:1787786536.358943:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786536.358988:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686819584 00000100:00100000:2.0:1787786536.358994:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686819584 00000100:00100000:2.0:1787786536.359020:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787786536.359026:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5233338b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1874629686819584:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787786536.359076:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5233338b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1874629686819584:12345-0@lo:8:kworker.0 Request processed in 49us (133us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787786536.359095:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787786536.359127:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787786536.359133:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b52117ba000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787786536.359137:0:3310:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787786536.359139:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874629686819584:0@lo:8:kworker.0 00000040:00080000:2.0:1787786536.360138:0:15806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:1.0:1787786536.361060:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686819456:0@lo:400:kworker.0 00000100:00100000:1.0:1787786536.361139:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786536.361254:0:15614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686819456 00000100:00100000:2.0:1787786536.361261:0:15614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686819456 00000100:00100000:2.0:1787786536.361317:0:15614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787786536.361326:0:15614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3311:x1874629686819456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786536.361379:0:15614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3311:x1874629686819456:12345-0@lo:400:kworker.0 Request processed in 54us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786536.361386:0:15614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787786536.361422:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686819456:0@lo:400:kworker.0 00000100:00080000:1.0:1787786536.361482:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000000:0.0:1787786536.361852:0:15795:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1787786536.361889:0:15795:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787786536.361910:0:15795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7400/0x450132973bff337e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff3385 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786536.361920:0:15795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7400/0x450132973bff337e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff3385 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787786536.361971:0:15795:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787786536.361973:0:15795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787786536.361975:0:15795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787786536.361980:0:15795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787786536.361981:0:15795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787786536.361983:0:15795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787786536.361984:0:15795:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787786536.361985:0:15795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787786536.361986:0:15795:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787786536.361990:0:15795:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1787786536.361992:0:15795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787786536.361993:0:15795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787786536.361994:0:15795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787786536.361994:0:15795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787786536.361995:0:15795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787786536.361997:0:15795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787786536.361997:0:15795:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787786536.361998:0:15795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787786536.361999:0:15795:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787786536.362021:0:15795:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1787786536.362034:0:15795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103291a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686819968:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787786536.362072:0:15795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786536.362112:0:15795:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5206fd30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787786536.362669:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686819968 00000100:00100000:2.0:1787786536.362675:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686819968 00000100:00100000:2.0:1787786536.362719:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787786536.362726:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523289c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+19:15795:x1874629686819968:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787786536.362750:0:14388:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787786536.362764:0:14388:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787786536.390093:0:14388:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787786536.390117:0:14388:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787786536.390182:0:14409:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787786536.390188:0:14409:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787786536.390210:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b523bcb6800/0x450132973bff33a1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786536.390230:0:14409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b52421d5600/0x450132973bff327b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff3274 expref: 19 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786536.390239:0:14409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b523bcb6800/0x450132973bff33a1 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786536.390280:0:14409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b52421d5600/0x450132973bff327b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff3274 expref: 19 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786536.390295:0:14409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b52421d5600/0x450132973bff327b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff3274 expref: 19 pid: 14385 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786536.390312:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d5680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14409:1874629686820096:0@lo:104: 00000100:00100000:3.0:1787786536.390385:0:14409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786536.390439:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5202af8300 going to sleep for 11 seconds 00000100:00100000:2.0:1787786536.391025:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686820096 00000100:00100000:2.0:1787786536.391034:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686820096 00000100:00100000:2.0:1787786536.391106:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787786536.391115:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+3:14409:x1874629686820096:12345-0@lo:104: 00010000:00010000:2.0:1787786536.391131:0:14376:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff3274 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff327b expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786536.391196:0:14376:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787786536.391202:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+3:14409:x1874629686820096:12345-0@lo:104: Request processed in 89us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786536.391209:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787786536.391232:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787786536.391238:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff3274 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff327b expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786536.391245:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912d800 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:2.0:1787786536.391250:0:14381:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff3274 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff327b expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786536.391259:0:14381:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff3274 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff327b expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787786536.391266:0:14381:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff3274 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff327b expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787786536.391279:0:14381:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787786536.391310:0:14381:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff3274 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff327b expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786536.391317:0:14381:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787786536.391336:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff3274 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff327b expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786536.391343:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b520912d800/0x450132973bff3274 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff327b expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786536.391359:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786536.391362:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787786536.391363:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787786536.391383:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523333ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3311:1874629686820224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787786536.391413:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786536.391458:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686820224 00000100:00100000:2.0:1787786536.391462:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686820224 00010000:00010000:2.0:1787786536.391479:0:14380:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b52421d5600/0x450132973bff327b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff3274 expref: 20 pid: 14385 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786536.391501:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787786536.391508:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523333a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+20:3311:x1874629686820224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787786536.391518:0:14380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787786536.391523:0:14380:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b52421d5600/0x450132973bff327b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff3274 expref: 20 pid: 14385 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786536.391532:0:14380:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b52421d5600/0x450132973bff327b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff3274 expref: 20 pid: 14385 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786536.391556:0:14380:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b523bcb6800/0x450132973bff33a1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786536.391564:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b523bcb6800/0x450132973bff33a1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787786536.391692:0:14380:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001701814s 00010000:00010000:2.0:1787786536.391697:0:14380:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b523bcb6800/0x450132973bff33a1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786536.391705:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b523bcb6800/0x450132973bff33a1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786536.391712:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b523bcb6800/0x450132973bff33a1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786536.391718:0:14380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b523bcb6800/0x450132973bff33a1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786536.391724:0:14380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb6800 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:2.0:1787786536.391728:0:14380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b523bcb6800/0x450132973bff33a1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786536.391734:0:14380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b523bcb6800/0x450132973bff33a1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786536.391743:0:14380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b523bcb6800/0x450132973bff33a1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786536.392433:0:14380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787786536.392505:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b52421d5600/0x450132973bff327b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff3274 expref: 20 pid: 14385 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786536.392524:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d5680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14409:1874629686820096:0@lo:104: 00010000:00010000:2.0:1787786536.392543:0:14409:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b523bcb6800/0x450132973bff33a1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786536.392551:0:14409:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b523bcb6800/0x450132973bff33a1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786536.392558:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b523bcb6800/0x450132973bff33a1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786536.392564:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b523bcb6800/0x450132973bff33a1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786536.392627:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523333a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+19:3311:x1874629686820224:12345-0@lo:103:ldlm_bl.0 Request processed in 1119us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786536.392636:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787786536.392669:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523333ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3311:1874629686820224:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787786536.397561:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523289c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+18:15795:x1874629686819968:12345-0@lo:253:mount.lustre.0 Request processed in 34825us (35478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786536.397586:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787786536.397714:0:15795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103291a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:15795:1874629686819968:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787786536.397731:0:15795:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1787786536.397735:0:15795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787786536.397737:0:15795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1787786536.397738:0:15795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787786536.397740:0:15795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787786536.397741:0:15795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787786536.397742:0:15795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787786536.397743:0:15795:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787786536.397860:0:15795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787786536.397862:0:15795:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787786536.397877:0:15795:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787786536.404692:0:15795:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787786536.405297:0:15795:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787786536.405478:0:15795:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787786536.405702:0:15795:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787786536.405985:0:15795:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787786536.406221:0:15795:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787786536.407119:0:15795:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787786536.454262:0:15795:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787786536.454273:0:15795:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787786536.454306:0:15795:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787786536.454372:0:15795:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.134@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787786536.454387:0:15795:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787786536.454417:0:15795:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1787786537.358523:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787786537.606158:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787786537.606183:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 10000000:01000000:0.0:1787786538.250937:0:14390:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787786538.250946:0:14390:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8b51033ae000 from 8 10000000:01000000:0.0:1787786538.250951:0:14390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787786538.250999:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520912da00/0x450132973bff33a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786538.251027:0:14390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b520912da00/0x450132973bff33a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786538.251040:0:14390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b520912da00/0x450132973bff33a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786538.251076:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103291a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686820352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787786538.251144:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786538.251197:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5208f50a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787786538.252457:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686820352 00000100:00100000:2.0:1787786538.252468:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686820352 00000100:00100000:2.0:1787786538.252525:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787786538.252545:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523289f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+18:14390:x1874629686820352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787786538.252562:0:14386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786538.252578:0:14386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b523d7a8e00/0x450132973bff33af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff33a8 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786538.252607:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b523d7a8e00/0x450132973bff33af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff33a8 expref: 19 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786538.252617:0:14386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b523d7a8e00/0x450132973bff33af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff33a8 expref: 19 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786538.252625:0:14386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523d7a8e00, rc 0) 00000100:00100000:2.0:1787786538.252698:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523289f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+19:14390:x1874629686820352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (1553us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786538.252705:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787786538.252787:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103291a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686820352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787786538.252818:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b520912da00/0x450132973bff33a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff33af expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786538.252827:0:14390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b520912da00/0x450132973bff33a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff33af expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786538.252889:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686820480:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787786538.252926:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786538.252947:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52328bd840 going to sleep for 11 seconds 00000100:00100000:2.0:1787786538.253004:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686820480 00000100:00100000:2.0:1787786538.253009:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686820480 00000100:00100000:2.0:1787786538.253031:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787786538.253038:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523289fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+19:14390:x1874629686820480:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787786538.253062:0:14388:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787786538.253078:0:14388:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787786538.253086:0:14388:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1787786538.253261:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523289fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+19:14390:x1874629686820480:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 223us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786538.253268:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686820480:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787786538.253326:0:14390:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787786538.253333:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520912da00/0x450132973bff33a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff33af expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786538.253341:0:14390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b520912da00/0x450132973bff33a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff33af expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786538.253495:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:2.0:1787786538.380537:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786538.507354:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787786538.512704:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686820608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787786538.517270:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786538.521677:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686820608 00000100:00100000:1.0:1787786538.521697:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686820608 00000100:00100000:1.0:1787786538.521774:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787786538.521804:0:15081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686820608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787786538.521845:0:15081:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787786538.521937:0:15081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686820608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (9147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786538.521945:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787786538.521969:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787786538.522209:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787786538.522238:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686820608:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787786539.401990:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787786539.916338:0:14428:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787786540.426785:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786541.451418:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786541.588116:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523333ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3313:1874629686820736:0@lo:400:kworker.0 00000100:00100000:1.0:1787786541.588224:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786541.589833:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686820736 00000100:00100000:0.0:1787786541.589844:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686820736 00000100:00100000:0.0:1787786541.591997:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787786541.592019:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b43f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+19:3313:x1874629686820736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786541.592126:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b43f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+19:3313:x1874629686820736:12345-0@lo:400:kworker.0 Request processed in 116us (3901us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786541.592133:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787786541.593496:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523333ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3313:1874629686820736:0@lo:400:kworker.0 00000100:00100000:1.0:1787786541.596954:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:2.0:1787786541.596977:0:12641:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787786541.596992:0:12641:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787786541.596996:0:12641:0:(import.c:65:import_set_state_nolock()) ffff8b52117ba000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787786541.597008:0:12641:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8b52117ba000 using connection 192.168.204.134@tcp/0@lo 00000100:00100000:2.0:1787786541.597032:0:12641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8b5233339680 x1874629686820992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787786541.597131:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5233339680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874629686820992:0@lo:8:kworker.0 00000100:00100000:0.0:1787786541.597199:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786541.597257:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523333ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874629686821248:0@lo:400:kworker.0 00000100:00100000:0.0:1787786541.597282:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786541.597302:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787786541.597308:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523333a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874629686821120:0@lo:400:kworker.0 00000100:00100000:0.0:1787786541.597328:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786541.597356:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686820992 00000100:00100000:0.0:1787786541.597377:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686820992 00000100:00100000:0.0:1787786541.597411:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787786541.597418:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b51032921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1874629686820992:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787786541.597444:0:15078:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 467 last 0 00000020:00000080:0.0:1787786541.597475:0:15078:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x450132973bff33b6 00002000:00100000:0.0:1787786541.597487:0:15078:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8b5101384000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113935 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787786541.597491:0:15078:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787786541.597494:0:15078:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787786541.597827:0:15078:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787786541.597851:0:15078:0:(import.c:65:import_set_state_nolock()) ffff8b523becd000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787786541.597898:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b51032921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1874629686820992:12345-0@lo:8:kworker.0 Request processed in 479us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786541.597905:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787786541.597927:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686821248 00000100:00100000:0.0:1787786541.597931:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686821248 00000100:00100000:0.0:1787786541.597963:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686821120 00000100:00100000:0.0:1787786541.597965:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686821120 00000100:00100000:0.0:1787786541.597995:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787786541.598003:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103290f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874629686821248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786541.598038:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103290f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874629686821248:12345-0@lo:400:kworker.0 Request processed in 37us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786541.598044:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787786541.598056:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787786541.598062:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103291e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874629686821120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786541.598087:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103291e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874629686821120:12345-0@lo:400:kworker.0 Request processed in 25us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786541.598093:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1787786541.598123:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787786541.598155:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523333a580 x1874629686821120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787786557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786541.598169:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523333a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874629686821120:0@lo:400:kworker.0 00010000:00080000:0.0:1787786541.598180:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b523333ad00 x1874629686821248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787786557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787786541.598187:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523333ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874629686821248:0@lo:400:kworker.0 00010000:00080000:0.0:1787786541.598213:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5233339680 x1874629686820992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787786566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787786541.598223:0:3310:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787786541.598230:0:3310:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787786541.598235:0:3310:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787786541.598237:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8b52117ba000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787786541.598251:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787786541.598256:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5233339680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1874629686820992:0@lo:8:kworker.0 00000100:00100000:3.0:1787786541.598354:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b51032903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686821504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787786541.598387:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786541.598410:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787786541.598423:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5233338f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874629686821376:0@lo:400:kworker.0 00000100:00100000:3.0:1787786541.598449:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786541.598483:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686821504 00000100:00100000:3.0:1787786541.598487:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686821504 00000100:00100000:3.0:1787786541.598517:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787786541.598524:0:15081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874629686821504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787786541.598544:0:15081:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787786541.598575:0:15081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1874629686821504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786541.598580:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787786541.598603:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b51032903c0 x1874629686821504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787786557 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787786541.598615:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b51032903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686821504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787786541.599715:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5233338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686820864:0@lo:400:kworker.0 00000100:00100000:1.0:1787786541.599769:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786541.602593:0:15614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686820864 00000100:00100000:2.0:1787786541.602607:0:15614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686820864 00000100:00100000:2.0:1787786541.602823:0:15614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787786541.602836:0:15614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686820864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786541.602912:0:15614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c08780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686820864:12345-0@lo:400:kworker.0 Request processed in 80us (3143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786541.602920:0:15614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787786541.602996:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5233338000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686820864:0@lo:400:kworker.0 00000004:00080000:1.0:1787786541.605139:0:14417:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787786541.605530:0:14417:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 467963738661ns, next at 0ns, rc = 0 00000100:00100000:1.0:1787786541.605573:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686821376 00000100:00100000:1.0:1787786541.605581:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686821376 00000100:00100000:1.0:1787786541.605634:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787786541.605643:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874629686821376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786541.605722:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1874629686821376:12345-0@lo:400:kworker.0 Request processed in 81us (7272us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786541.605729:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1787786541.605822:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787786541.605826:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787786541.605829:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1787786541.605834:0:14418:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:0.0:1787786541.605868:0:14418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5103290000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14418:1874629686821632:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787786541.605904:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786541.605933:0:14418:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5208f500c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787786541.606001:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686821632 00000100:00100000:1.0:1787786541.606005:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686821632 00000100:00100000:1.0:1787786541.606035:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787786541.606041:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b51032903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14418:x1874629686821632:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787786541.608169:0:15078:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1787786541.608179:0:15078:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1787786541.608185:0:15078:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00010000:00080000:2.0:1787786541.608616:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8b5233338f00 x1874629686821376/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787786557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787786541.608634:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5233338f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1874629686821376:0@lo:400:kworker.0 00002000:00010000:1.0:1787786541.623157:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787786541.623169:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e96b02/0x450132973bff33bd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.623188:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1787786541.623200:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786541.623206:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090e96b02/0x450132973bff33bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.623226:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090e96b02/0x450132973bff33bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.623236:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e96b02/0x450132973bff33bd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.623243:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090e96b02/0x450132973bff33bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.623266:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787786541.623697:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787786541.623703:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbbf28f4/0x450132973bff33c4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.623711:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1787786541.623714:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786541.623718:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbbf28f4/0x450132973bff33c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.623727:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbbf28f4/0x450132973bff33c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.623736:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbbf28f4/0x450132973bff33c4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.623749:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bbbf28f4/0x450132973bff33c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.623765:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787786541.623776:0:14382:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787786541.623782:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090e96b02/0x450132973bff33bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.623813:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8000 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:1.0:1787786541.623817:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e96b02/0x450132973bff33bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.623826:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e96b02/0x450132973bff33bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.623842:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090e96b02/0x450132973bff33bd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.623850:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090e96b02/0x450132973bff33bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.623866:0:14382:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787786541.623869:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bbbf28f4/0x450132973bff33c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.623886:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d9a00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:1.0:1787786541.623889:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbbf28f4/0x450132973bff33c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.623897:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbbf28f4/0x450132973bff33c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.623906:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bbbf28f4/0x450132973bff33c4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.623914:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbbf28f4/0x450132973bff33c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.623925:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786541.623927:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786541.623928:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786541.627713:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787786541.627851:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787786541.627860:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2a032dd/0x450132973bff33cb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.627876:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1787786541.627880:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786541.627885:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2a032dd/0x450132973bff33cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.627897:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2a032dd/0x450132973bff33cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.627914:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2a032dd/0x450132973bff33cb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.627921:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2a032dd/0x450132973bff33cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.627939:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787786541.628587:0:14382:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787786541.628594:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2a032dd/0x450132973bff33cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.628615:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d9e00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:0.0:1787786541.628620:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2a032dd/0x450132973bff33cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.628630:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2a032dd/0x450132973bff33cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.628650:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2a032dd/0x450132973bff33cb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.628658:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2a032dd/0x450132973bff33cb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.628679:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786541.628681:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786541.628683:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787786541.628818:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787786541.628824:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd6a5695/0x450132973bff33d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.628833:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1787786541.628837:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786541.628841:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd6a5695/0x450132973bff33d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.628851:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd6a5695/0x450132973bff33d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.628859:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd6a5695/0x450132973bff33d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.628866:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd6a5695/0x450132973bff33d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.628891:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787786541.629287:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787786541.629292:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bac21a1f/0x450132973bff33d9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.629300:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1787786541.629303:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786541.629307:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bac21a1f/0x450132973bff33d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.629316:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bac21a1f/0x450132973bff33d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.629323:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bac21a1f/0x450132973bff33d9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.629331:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bac21a1f/0x450132973bff33d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.629343:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787786541.631663:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787786541.631676:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd6a5695/0x450132973bff33d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.631691:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d9000 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:0.0:1787786541.631696:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd6a5695/0x450132973bff33d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.631708:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd6a5695/0x450132973bff33d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.631736:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd6a5695/0x450132973bff33d2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.631744:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd6a5695/0x450132973bff33d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.631764:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787786541.631768:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bac21a1f/0x450132973bff33d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.631775:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d9200 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:0.0:1787786541.631779:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bac21a1f/0x450132973bff33d9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.631786:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bac21a1f/0x450132973bff33d9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.631812:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bac21a1f/0x450132973bff33d9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.631818:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bac21a1f/0x450132973bff33d9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.631830:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786541.631831:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786541.631839:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786541.631860:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787786541.634068:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787786541.634080:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7c0f557/0x450132973bff33e0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.634096:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1787786541.634106:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786541.634114:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7c0f557/0x450132973bff33e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.634127:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7c0f557/0x450132973bff33e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.634136:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7c0f557/0x450132973bff33e0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.634143:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7c0f557/0x450132973bff33e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.634164:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787786541.635634:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787786541.635645:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7c0f557/0x450132973bff33e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.635657:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8e00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:0.0:1787786541.635661:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7c0f557/0x450132973bff33e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.635670:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7c0f557/0x450132973bff33e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.635689:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7c0f557/0x450132973bff33e0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.635696:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7c0f557/0x450132973bff33e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.635716:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786541.635717:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786541.635719:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787786541.637761:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787786541.637777:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1c288a8/0x450132973bff33e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.637809:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1787786541.637814:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786541.637820:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1c288a8/0x450132973bff33e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.639833:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1c288a8/0x450132973bff33e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.639850:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1c288a8/0x450132973bff33e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.639867:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1c288a8/0x450132973bff33e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.639888:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787786541.641583:0:14382:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787786541.641596:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1c288a8/0x450132973bff33e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.641609:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d9600 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:0.0:1787786541.641613:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1c288a8/0x450132973bff33e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.641632:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1c288a8/0x450132973bff33e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.641651:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1c288a8/0x450132973bff33e7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.641658:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1c288a8/0x450132973bff33e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.641679:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786541.641681:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786541.641683:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787786541.641752:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787786541.641759:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fadf59a1/0x450132973bff33ee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.641771:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1787786541.641776:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786541.641783:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fadf59a1/0x450132973bff33ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.642564:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fadf59a1/0x450132973bff33ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.642575:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fadf59a1/0x450132973bff33ee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.642583:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fadf59a1/0x450132973bff33ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.642607:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787786541.643221:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787786541.643229:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee6abb1b/0x450132973bff33f5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.643246:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=467s v=(0 0) 00010000:00010000:1.0:1787786541.643250:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786541.643255:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee6abb1b/0x450132973bff33f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.643265:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee6abb1b/0x450132973bff33f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.643274:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee6abb1b/0x450132973bff33f5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.643280:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee6abb1b/0x450132973bff33f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.643294:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787786541.644681:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787786541.644692:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fadf59a1/0x450132973bff33ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.644704:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8400 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:0.0:1787786541.644708:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fadf59a1/0x450132973bff33ee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.644718:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fadf59a1/0x450132973bff33ee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.644739:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fadf59a1/0x450132973bff33ee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.644761:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fadf59a1/0x450132973bff33ee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.644783:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787786541.644820:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee6abb1b/0x450132973bff33f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.644827:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8600 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:0.0:1787786541.644830:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee6abb1b/0x450132973bff33f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.644837:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee6abb1b/0x450132973bff33f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.644847:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee6abb1b/0x450132973bff33f5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.644852:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee6abb1b/0x450132973bff33f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.644865:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786541.644866:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786541.644868:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786541.644892:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787786541.647385:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787786541.647396:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000700f24f9/0x450132973bff33fc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.647412:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1787786541.647416:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786541.647422:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000700f24f9/0x450132973bff33fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.647439:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000700f24f9/0x450132973bff33fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.647458:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000700f24f9/0x450132973bff33fc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.647465:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000700f24f9/0x450132973bff33fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.647497:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787786541.647508:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787786541.647513:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000700f24f9/0x450132973bff33fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.647520:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8a00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:1.0:1787786541.647524:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000700f24f9/0x450132973bff33fc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.647533:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000700f24f9/0x450132973bff33fc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.647548:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000700f24f9/0x450132973bff33fc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.647556:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000700f24f9/0x450132973bff33fc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.647573:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786541.647579:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786541.647581:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787786541.647995:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787786541.648001:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe4e554e/0x450132973bff3403 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.648009:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1787786541.648012:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786541.648016:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe4e554e/0x450132973bff3403 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.648024:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe4e554e/0x450132973bff3403 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.648032:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe4e554e/0x450132973bff3403 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.648039:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe4e554e/0x450132973bff3403 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.648054:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787786541.648061:0:14382:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787786541.648065:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe4e554e/0x450132973bff3403 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.648072:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d9c00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:1.0:1787786541.648075:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe4e554e/0x450132973bff3403 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787786541.655423:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787786541.655443:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8be5267/0x450132973bff340a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.655460:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1787786541.655465:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787786541.655478:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8be5267/0x450132973bff340a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.655492:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8be5267/0x450132973bff340a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.655502:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8be5267/0x450132973bff340a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.655509:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8be5267/0x450132973bff340a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.655534:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787786541.655955:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787786541.655962:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e62b07eb/0x450132973bff3411 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.655972:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1787786541.655975:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787786541.655992:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e62b07eb/0x450132973bff3411 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.656002:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e62b07eb/0x450132973bff3411 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.656017:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e62b07eb/0x450132973bff3411 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.656024:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e62b07eb/0x450132973bff3411 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.656032:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787786541.656406:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787786541.656412:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fd41b57/0x450132973bff3418 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.656421:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1787786541.656424:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787786541.656428:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fd41b57/0x450132973bff3418 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.656437:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fd41b57/0x450132973bff3418 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.656444:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fd41b57/0x450132973bff3418 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.656452:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007fd41b57/0x450132973bff3418 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.656471:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1787786541.656854:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787786541.656860:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a292851a/0x450132973bff341f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.656869:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1787786541.656872:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787786541.656877:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a292851a/0x450132973bff341f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.656886:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a292851a/0x450132973bff341f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.656894:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a292851a/0x450132973bff341f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.656900:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a292851a/0x450132973bff341f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.656908:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1787786541.657276:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787786541.657282:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056fb6dfd/0x450132973bff3426 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.657290:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1787786541.657298:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787786541.657302:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056fb6dfd/0x450132973bff3426 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.657310:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056fb6dfd/0x450132973bff3426 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.657318:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056fb6dfd/0x450132973bff3426 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.657325:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056fb6dfd/0x450132973bff3426 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.657333:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1787786541.658006:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe4e554e/0x450132973bff3403 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.658024:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe4e554e/0x450132973bff3403 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.658032:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe4e554e/0x450132973bff3403 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.658060:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787786541.658066:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8be5267/0x450132973bff340a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.658074:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912c000 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:1.0:1787786541.658078:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8be5267/0x450132973bff340a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.658086:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8be5267/0x450132973bff340a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.658095:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8be5267/0x450132973bff340a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.658103:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8be5267/0x450132973bff340a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.658127:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787786541.658131:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e62b07eb/0x450132973bff3411 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.658137:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912ca00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:1.0:1787786541.658140:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e62b07eb/0x450132973bff3411 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.658147:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e62b07eb/0x450132973bff3411 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.658157:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e62b07eb/0x450132973bff3411 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.658165:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e62b07eb/0x450132973bff3411 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.658176:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787786541.658180:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007fd41b57/0x450132973bff3418 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.658187:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912c800 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:1.0:1787786541.658190:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007fd41b57/0x450132973bff3418 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.658207:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007fd41b57/0x450132973bff3418 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.658217:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007fd41b57/0x450132973bff3418 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.658224:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fd41b57/0x450132973bff3418 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.658236:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787786541.658239:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a292851a/0x450132973bff341f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.658245:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912d200 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:1.0:1787786541.658248:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a292851a/0x450132973bff341f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.658254:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a292851a/0x450132973bff341f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.658262:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a292851a/0x450132973bff341f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.658267:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a292851a/0x450132973bff341f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.658286:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787786541.658289:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056fb6dfd/0x450132973bff3426 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.658295:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912c200 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:1.0:1787786541.658298:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056fb6dfd/0x450132973bff3426 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.658305:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056fb6dfd/0x450132973bff3426 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.658315:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056fb6dfd/0x450132973bff3426 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.658322:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056fb6dfd/0x450132973bff3426 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.658333:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786541.658335:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786541.658336:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786541.658341:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786541.658343:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786541.658344:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787786541.661733:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787786541.661749:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023618f3d/0x450132973bff342d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.661768:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1787786541.661773:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787786541.661779:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023618f3d/0x450132973bff342d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.661808:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023618f3d/0x450132973bff342d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.661820:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023618f3d/0x450132973bff342d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.661835:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023618f3d/0x450132973bff342d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.661856:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787786541.661869:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787786541.661875:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023618f3d/0x450132973bff342d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.661882:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912c600 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:0.0:1787786541.661887:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023618f3d/0x450132973bff342d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.661896:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023618f3d/0x450132973bff342d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.661913:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023618f3d/0x450132973bff342d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.661920:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023618f3d/0x450132973bff342d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.661937:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786541.661939:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786541.661941:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787786541.662497:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787786541.662511:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a070de8/0x450132973bff3434 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.662520:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1787786541.662524:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787786541.662527:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000a070de8/0x450132973bff3434 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.662535:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000a070de8/0x450132973bff3434 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.662542:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000a070de8/0x450132973bff3434 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.662549:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000a070de8/0x450132973bff3434 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.662565:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787786541.662990:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787786541.662997:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000717dbb40/0x450132973bff343b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.663006:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1787786541.663010:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787786541.663014:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000717dbb40/0x450132973bff343b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.663023:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000717dbb40/0x450132973bff343b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.663036:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000717dbb40/0x450132973bff343b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.663043:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000717dbb40/0x450132973bff343b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.663056:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787786541.663063:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787786541.663067:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000a070de8/0x450132973bff3434 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.663074:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912d600 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:0.0:1787786541.663079:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000a070de8/0x450132973bff3434 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.663086:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000a070de8/0x450132973bff3434 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.663098:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000a070de8/0x450132973bff3434 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.663104:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000a070de8/0x450132973bff3434 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.663118:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787786541.663126:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000717dbb40/0x450132973bff343b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.663133:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912d800 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:0.0:1787786541.663136:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000717dbb40/0x450132973bff343b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.663144:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000717dbb40/0x450132973bff343b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.663152:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000717dbb40/0x450132973bff343b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.663159:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000717dbb40/0x450132973bff343b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.663171:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786541.663173:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786541.663174:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787786541.663554:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787786541.663561:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cfe86a2/0x450132973bff3442 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.663570:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1787786541.663573:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787786541.663577:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001cfe86a2/0x450132973bff3442 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.663597:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001cfe86a2/0x450132973bff3442 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.663605:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001cfe86a2/0x450132973bff3442 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.663613:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001cfe86a2/0x450132973bff3442 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.663625:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787786541.663632:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787786541.663635:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001cfe86a2/0x450132973bff3442 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.663641:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912de00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:0.0:1787786541.663644:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001cfe86a2/0x450132973bff3442 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.663652:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001cfe86a2/0x450132973bff3442 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.663660:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001cfe86a2/0x450132973bff3442 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.663667:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001cfe86a2/0x450132973bff3442 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.663685:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786541.663687:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786541.663688:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787786541.664092:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787786541.664098:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f43d737c/0x450132973bff3449 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.664108:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1787786541.664111:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787786541.664116:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f43d737c/0x450132973bff3449 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.664124:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f43d737c/0x450132973bff3449 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.664132:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f43d737c/0x450132973bff3449 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.664139:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f43d737c/0x450132973bff3449 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.664155:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787786541.664163:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787786541.664167:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f43d737c/0x450132973bff3449 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.664184:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912ce00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:0.0:1787786541.664188:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f43d737c/0x450132973bff3449 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.664196:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f43d737c/0x450132973bff3449 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.664207:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f43d737c/0x450132973bff3449 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.664214:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f43d737c/0x450132973bff3449 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.664228:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786541.664229:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786541.664231:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786541.665620:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787786541.665884:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787786541.665892:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041e3f92c/0x450132973bff3450 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.665905:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1787786541.665909:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787786541.665913:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041e3f92c/0x450132973bff3450 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.665925:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041e3f92c/0x450132973bff3450 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.665938:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041e3f92c/0x450132973bff3450 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.665943:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041e3f92c/0x450132973bff3450 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.665959:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787786541.666334:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787786541.666340:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056fb6dfd/0x450132973bff3457 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.666347:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=468s v=(0 0) 00010000:00010000:0.0:1787786541.666350:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787786541.666353:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056fb6dfd/0x450132973bff3457 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.666362:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056fb6dfd/0x450132973bff3457 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.666369:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056fb6dfd/0x450132973bff3457 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.666376:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056fb6dfd/0x450132973bff3457 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.666399:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787786541.666572:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787786541.666578:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041e3f92c/0x450132973bff3450 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.666592:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912dc00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:1.0:1787786541.666596:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041e3f92c/0x450132973bff3450 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.666604:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041e3f92c/0x450132973bff3450 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.666618:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041e3f92c/0x450132973bff3450 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.666625:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041e3f92c/0x450132973bff3450 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.666640:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787786541.666643:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056fb6dfd/0x450132973bff3457 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.666649:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912c200 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:1.0:1787786541.666652:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056fb6dfd/0x450132973bff3457 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.666658:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056fb6dfd/0x450132973bff3457 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.666666:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056fb6dfd/0x450132973bff3457 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.666678:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056fb6dfd/0x450132973bff3457 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.666689:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786541.666691:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786541.666692:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786541.666699:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787786541.671539:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787786541.671552:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe4e554e/0x450132973bff345e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.671568:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1787786541.671573:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786541.671580:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe4e554e/0x450132973bff345e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.671595:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe4e554e/0x450132973bff345e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.671605:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe4e554e/0x450132973bff345e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.671613:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe4e554e/0x450132973bff345e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.671640:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787786541.672120:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787786541.672126:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000700f24f9/0x450132973bff3465 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.672135:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1787786541.672138:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786541.672143:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000700f24f9/0x450132973bff3465 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.672153:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000700f24f9/0x450132973bff3465 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.672161:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000700f24f9/0x450132973bff3465 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.672168:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000700f24f9/0x450132973bff3465 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.672184:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787786541.673588:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787786541.673600:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe4e554e/0x450132973bff345e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.673612:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d9c00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:0.0:1787786541.673617:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe4e554e/0x450132973bff345e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.673627:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe4e554e/0x450132973bff345e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.673647:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe4e554e/0x450132973bff345e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.673654:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe4e554e/0x450132973bff345e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.673674:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787786541.673678:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000700f24f9/0x450132973bff3465 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.673684:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8a00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:0.0:1787786541.673687:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000700f24f9/0x450132973bff3465 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.673708:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000700f24f9/0x450132973bff3465 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.673718:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000700f24f9/0x450132973bff3465 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.673724:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000700f24f9/0x450132973bff3465 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.673738:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786541.673739:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786541.673741:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786541.674590:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787786541.674656:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1787786541.675801:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787786541.675814:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbbf28f4/0x450132973bff346c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.675829:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1787786541.675833:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786541.675840:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbbf28f4/0x450132973bff346c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.675865:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbbf28f4/0x450132973bff346c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.675876:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbbf28f4/0x450132973bff346c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.675884:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bbbf28f4/0x450132973bff346c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.675904:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787786541.676394:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787786541.676401:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e96b02/0x450132973bff3473 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.676410:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1787786541.676413:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786541.676417:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090e96b02/0x450132973bff3473 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.676426:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090e96b02/0x450132973bff3473 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.676434:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090e96b02/0x450132973bff3473 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.676451:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090e96b02/0x450132973bff3473 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.676465:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787786541.677598:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787786541.677608:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bbbf28f4/0x450132973bff346c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.677619:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d9a00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:0.0:1787786541.677624:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbbf28f4/0x450132973bff346c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.677633:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbbf28f4/0x450132973bff346c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.677650:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bbbf28f4/0x450132973bff346c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.677667:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbbf28f4/0x450132973bff346c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.677687:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787786541.677690:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090e96b02/0x450132973bff3473 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.677696:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8000 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:0.0:1787786541.677698:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e96b02/0x450132973bff3473 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.677705:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090e96b02/0x450132973bff3473 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.677714:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090e96b02/0x450132973bff3473 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.677720:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786541.677721:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786541.677723:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786541.677730:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787786541.677849:0:15078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090e96b02/0x450132973bff3473 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787786541.679126:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787786541.679136:0:15078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c740c608/0x450132973bff347a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.679147:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1787786541.679151:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786541.679156:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c740c608/0x450132973bff347a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.679167:0:15078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c740c608/0x450132973bff347a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.679176:0:15078:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c740c608/0x450132973bff347a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.679183:0:15078:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c740c608/0x450132973bff347a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786541.679260:0:15078:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1787786541.679449:0:15078:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:1.0:1787786541.679558:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b51032903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14418:x1874629686821632:12345-0@lo:5:osp-pre-1-0.0 Request processed in 73512us (73648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786541.679568:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787786541.679630:0:14418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5103290000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14418:1874629686821632:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787786541.679645:0:14418:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1787786541.679690:0:14418:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5237c0ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14418:1874629686821760:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1787786541.679724:0:14418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786541.679765:0:14418:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52304be480 going to sleep for 11 seconds 00000100:00100000:1.0:1787786541.679785:0:15614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686821760 00000100:00100000:1.0:1787786541.679815:0:15614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686821760 00000100:00100000:1.0:1787786541.679853:0:15614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787786541.679862:0:15614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14418:x1874629686821760:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1787786541.679902:0:15614:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:0.0:1787786541.684135:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787786541.684150:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c740c608/0x450132973bff347a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.684164:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8c00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:0.0:1787786541.684176:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c740c608/0x450132973bff347a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.684188:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c740c608/0x450132973bff347a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.684210:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c740c608/0x450132973bff347a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.684217:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c740c608/0x450132973bff347a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786541.684239:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786541.684241:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786541.684243:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786541.692392:0:15614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:14418:x1874629686821760:12345-0@lo:5:osp-pre-1-0.0 Request processed in 12525us (12661us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787786541.692405:0:15614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787786541.692620:0:14418:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5237c0ad00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14418:1874629686821760:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787786541.692636:0:14418:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1787786542.477040:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787786542.651051:0:16151:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg434-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787786543.498406:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786543.631433:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5233338f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686821888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787786543.631518:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786543.631630:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686821888 00000100:00100000:1.0:1787786543.631639:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686821888 00000100:00100000:1.0:1787786543.631727:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787786543.631739:0:15081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103293480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686821888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787786543.631786:0:15081:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787786543.634874:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787786543.646654:0:15081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103293480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686821888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 14905us (15122us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786543.646674:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787786543.647063:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5233338f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686821888:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787786544.522373:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786544.929296:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786544.936092:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667954304 00000100:00100000:2.0:1787786544.936109:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667954304 00000100:00100000:2.0:1787786544.936166:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 75 00000100:00100000:2.0:1787786544.936177:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b43e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2361:x1874629667954304:12345-192.168.204.34@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787786544.936209:0:14388:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 380b0949-bde9-4f98-9870-b4d676348301@192.168.204.34@tcp t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:2.0:1787786544.936240:0:14388:0:(genops.c:1385:class_connect()) connect: client 380b0949-bde9-4f98-9870-b4d676348301, cookie 0x450132973bff3481 00000100:00080000:2.0:1787786544.936408:0:14388:0:(import.c:65:import_set_state_nolock()) ffff8b5237bd3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787786544.936499:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b43e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:380b0949-bde9-4f98-9870-b4d676348301+5:2361:x1874629667954304:12345-192.168.204.34@tcp:250:mount.lustre.0 Request processed in 322us (7212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786544.936507:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 75 00000100:00100000:1.0:1787786544.966824:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786544.966899:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667954432 00000100:00100000:3.0:1787786544.966910:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667954432 00000100:00100000:3.0:1787786544.966983:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 76 00000100:00100000:3.0:1787786544.966994:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b43fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:380b0949-bde9-4f98-9870-b4d676348301+5:13767:x1874629667954432:12345-192.168.204.34@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787786544.967013:0:14385:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786544.967032:0:14385:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b523bcb7000/0x450132973bff3488 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7525bd expref: -99 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786544.967064:0:14385:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b523bcb7000/0x450132973bff3488 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7525bd expref: 6 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786544.967076:0:14385:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b523bcb7000/0x450132973bff3488 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7525bd expref: 6 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786544.967105:0:14385:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb7000, rc 0) 00000100:00100000:3.0:1787786544.967173:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b43fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:380b0949-bde9-4f98-9870-b4d676348301+6:13767:x1874629667954432:12345-192.168.204.34@tcp:101:mount.lustre.0 Request processed in 181us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786544.967181:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 76 00000100:00100000:3.0:1787786544.969609:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786544.970596:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667954560 00000100:00100000:0.0:1787786544.970614:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667954560 00000100:00100000:0.0:1787786544.970822:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 77 00000100:00100000:0.0:1787786544.970834:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b43c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:380b0949-bde9-4f98-9870-b4d676348301+6:13767:x1874629667954560:12345-192.168.204.34@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787786544.971290:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b43c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:380b0949-bde9-4f98-9870-b4d676348301+6:13767:x1874629667954560:12345-192.168.204.34@tcp:501:mount.lustre.0 Request processed in 456us (1692us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787786544.971299:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 77 00000100:00100000:1.0:1787786544.975135:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786544.975535:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667954688 00000100:00100000:0.0:1787786544.975567:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667954688 00000100:00100000:0.0:1787786544.975761:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 78 00000100:00100000:0.0:1787786544.975775:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b43dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:380b0949-bde9-4f98-9870-b4d676348301+6:13767:x1874629667954688:12345-192.168.204.34@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787786544.975853:0:14386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786544.975880:0:14386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b520912d600/0x450132973bff348f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7525c4 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786544.975931:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b520912d600/0x450132973bff348f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7525c4 expref: 7 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786544.975946:0:14386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b520912d600/0x450132973bff348f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7525c4 expref: 7 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786544.976082:0:14386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912d600, rc 0) 00000100:00100000:0.0:1787786544.976559:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b43dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:380b0949-bde9-4f98-9870-b4d676348301+7:13767:x1874629667954688:12345-192.168.204.34@tcp:101:mount.lustre.0 Request processed in 785us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786544.976569:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 78 00000100:00100000:1.0:1787786544.981742:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786544.982106:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667954816 00000100:00100000:2.0:1787786544.982119:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667954816 00000100:00100000:2.0:1787786544.982303:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 79 00000100:00100000:2.0:1787786544.982317:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b43d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:380b0949-bde9-4f98-9870-b4d676348301+7:13767:x1874629667954816:12345-192.168.204.34@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787786544.983512:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b43d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:380b0949-bde9-4f98-9870-b4d676348301+8:13767:x1874629667954816:12345-192.168.204.34@tcp:501:mount.lustre.0 Request processed in 1187us (1775us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786544.983597:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 79 00000100:00100000:0.0:1787786544.990876:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786544.991533:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667954944 00000100:00100000:2.0:1787786544.991550:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667954944 00000100:00100000:2.0:1787786544.991746:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 80 00000100:00100000:2.0:1787786544.991761:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b43ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:380b0949-bde9-4f98-9870-b4d676348301+8:13767:x1874629667954944:12345-192.168.204.34@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787786544.992176:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b43ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:380b0949-bde9-4f98-9870-b4d676348301+8:13767:x1874629667954944:12345-192.168.204.34@tcp:503:mount.lustre.0 Request processed in 417us (1316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786544.992193:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 80 00000100:00100000:1.0:1787786544.999254:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786545.001410:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667955072 00000100:00100000:2.0:1787786545.001434:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667955072 00000100:00100000:2.0:1787786545.001530:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 81 00000100:00100000:2.0:1787786545.001543:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b43d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:380b0949-bde9-4f98-9870-b4d676348301+8:13786:x1874629667955072:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787786545.003543:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b43d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:380b0949-bde9-4f98-9870-b4d676348301+8:13786:x1874629667955072:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 1984us (4290us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786545.003562:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 81 00000100:00100000:0.0:1787786545.034558:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786545.034774:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667955200 00000100:00100000:2.0:1787786545.034830:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667955200 00000100:00100000:2.0:1787786545.034904:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 82 00000100:00100000:2.0:1787786545.034928:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b43c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:380b0949-bde9-4f98-9870-b4d676348301+8:13786:x1874629667955200:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787786545.035363:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b43c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:380b0949-bde9-4f98-9870-b4d676348301+8:13786:x1874629667955200:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 446us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786545.035373:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 82 00000100:00100000:0.0:1787786545.046169:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786545.046897:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667955328 00000100:00100000:2.0:1787786545.046913:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667955328 00000100:00100000:2.0:1787786545.047014:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 83 00000100:00100000:2.0:1787786545.047027:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b43c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:380b0949-bde9-4f98-9870-b4d676348301+8:13767:x1874629667955328:12345-192.168.204.34@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787786545.047050:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786545.047077:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b523d7a8600/0x450132973bff3496 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7525ee expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786545.047115:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b523d7a8600/0x450132973bff3496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7525ee expref: 9 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786545.047153:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b523d7a8600/0x450132973bff3496 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7525ee expref: 9 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786545.047165:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523d7a8600, rc 0) 00000100:00100000:2.0:1787786545.047266:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b43c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:380b0949-bde9-4f98-9870-b4d676348301+9:13767:x1874629667955328:12345-192.168.204.34@tcp:101:mount.lustre.0 Request processed in 242us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786545.047274:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 83 00000100:00100000:0.0:1787786545.064427:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786545.064639:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667955456 00000100:00100000:3.0:1787786545.064651:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667955456 00000100:00100000:3.0:1787786545.064719:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 84 00000100:00100000:3.0:1787786545.064729:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b43f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:380b0949-bde9-4f98-9870-b4d676348301+9:13767:x1874629667955456:12345-192.168.204.34@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787786545.064761:0:14385:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787786545.064829:0:14385:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787786545.064834:0:14385:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787786545.064837:0:14385:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787786545.064839:0:14385:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1787786545.075104:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b43f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:380b0949-bde9-4f98-9870-b4d676348301+9:13767:x1874629667955456:12345-192.168.204.34@tcp:256:mount.lustre.0 Request processed in 10062us (10388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786545.075292:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 84 00000100:00100000:0.0:1787786545.090002:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786545.091246:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667955584 00000100:00100000:2.0:1787786545.091265:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667955584 00000100:00100000:2.0:1787786545.091350:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 85 00000100:00100000:2.0:1787786545.091361:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b43cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:380b0949-bde9-4f98-9870-b4d676348301+9:13767:x1874629667955584:12345-192.168.204.34@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787786545.091379:0:14386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786545.091401:0:14386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b523d7a9800/0x450132973bff349d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7525f5 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786545.091438:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b523d7a9800/0x450132973bff349d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7525f5 expref: 10 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786545.091453:0:14386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b523d7a9800/0x450132973bff349d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7525f5 expref: 10 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786545.091464:0:14386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523d7a9800, rc 0) 00000100:00100000:2.0:1787786545.091541:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b43cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:380b0949-bde9-4f98-9870-b4d676348301+10:13767:x1874629667955584:12345-192.168.204.34@tcp:101:mount.lustre.0 Request processed in 181us (1557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786545.091548:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 85 00000100:00100000:0.0:1787786545.105953:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786545.106108:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667955712 00000100:00100000:3.0:1787786545.106122:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667955712 00000100:00100000:3.0:1787786545.106195:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 86 00000100:00100000:3.0:1787786545.106207:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b43f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:380b0949-bde9-4f98-9870-b4d676348301+10:13767:x1874629667955712:12345-192.168.204.34@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787786545.106666:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b43f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:380b0949-bde9-4f98-9870-b4d676348301+10:13767:x1874629667955712:12345-192.168.204.34@tcp:501:mount.lustre.0 Request processed in 458us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786545.106676:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 86 00000100:00100000:1.0:1787786545.121167:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786545.121482:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667955840 00000100:00100000:2.0:1787786545.121516:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667955840 00000100:00100000:2.0:1787786545.121588:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 87 00000100:00100000:2.0:1787786545.121601:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b43e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:380b0949-bde9-4f98-9870-b4d676348301+10:13767:x1874629667955840:12345-192.168.204.34@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787786545.121977:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b43e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:380b0949-bde9-4f98-9870-b4d676348301+10:13767:x1874629667955840:12345-192.168.204.34@tcp:503:mount.lustre.0 Request processed in 376us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786545.121987:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 87 00000100:00100000:1.0:1787786545.138258:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786545.138384:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667955968 00000100:00100000:0.0:1787786545.138400:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667955968 00000100:00100000:0.0:1787786545.138471:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 88 00000100:00100000:0.0:1787786545.138484:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b43e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:380b0949-bde9-4f98-9870-b4d676348301+10:13791:x1874629667955968:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787786545.138870:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b43e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:380b0949-bde9-4f98-9870-b4d676348301+10:13791:x1874629667955968:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 387us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786545.138887:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 88 00000100:00100000:0.0:1787786545.152750:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786545.154881:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667956096 00000100:00100000:2.0:1787786545.154921:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667956096 00000100:00100000:2.0:1787786545.155024:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 89 00000100:00100000:2.0:1787786545.155038:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523baef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:380b0949-bde9-4f98-9870-b4d676348301+10:13791:x1874629667956096:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787786545.155445:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523baef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:380b0949-bde9-4f98-9870-b4d676348301+10:13791:x1874629667956096:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 407us (2710us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786545.155456:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 89 00000100:00100000:1.0:1787786545.179516:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786545.179877:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667956224 00000100:00100000:0.0:1787786545.179894:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667956224 00000100:00100000:0.0:1787786545.180005:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 4 00000100:00100000:0.0:1787786545.180018:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2361:x1874629667956224:12345-192.168.204.34@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787786545.180064:0:14393:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 7d7927fc-831f-42ff-8d88-89c0cf102351@192.168.204.34@tcp t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:0.0:1787786545.180140:0:14393:0:(genops.c:1385:class_connect()) connect: client 7d7927fc-831f-42ff-8d88-89c0cf102351, cookie 0x450132973bff34a4 00000004:00100000:0.0:1787786545.180212:0:14393:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1787786545.180222:0:14393:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1787786545.227785:0:14393:0:(import.c:65:import_set_state_nolock()) ffff8b510229a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787786545.228206:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+6:2361:x1874629667956224:12345-192.168.204.34@tcp:38:mount.lustre.0 Request processed in 48186us (48699us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786545.228217:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 4 00000100:00100000:1.0:1787786545.230947:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786545.231103:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786545.235292:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667956480 00000100:00100000:0.0:1787786545.235310:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667956480 00000100:00080000:1.0:1787786545.235478:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787786545.235509:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667956352 00000100:00100000:0.0:1787786545.235513:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667956352 00000100:00100000:0.0:1787786545.235553:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 5 00000100:00100000:0.0:1787786545.235564:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+7:13767:x1874629667956480:12345-192.168.204.34@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787786545.235614:0:14394:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787786545.235713:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+7:13767:x1874629667956480:12345-192.168.204.34@tcp:41:mount.lustre.0 Request processed in 150us (4776us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786545.235721:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 5 00000100:00100000:0.0:1787786545.235740:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 6 00000100:00100000:0.0:1787786545.235747:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+6:0:x1874629667956352:12345-192.168.204.34@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787786545.235758:0:14394:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787786545.235785:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+6:0:x1874629667956352:12345-192.168.204.34@tcp:41:mount.lustre.0 Request processed in 39us (4684us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786545.235831:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 6 00000100:00100000:0.0:1787786545.237805:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786545.237882:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667956608 00000100:00100000:1.0:1787786545.237891:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667956608 00000100:00100000:1.0:1787786545.237954:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:1.0:1787786545.237964:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103291a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+6:13767:x1874629667956608:12345-192.168.204.34@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787786545.238113:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103291a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+6:13767:x1874629667956608:12345-192.168.204.34@tcp:40:mount.lustre.0 Request processed in 150us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786545.238122:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:0.0:1787786545.240366:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786545.240698:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667956736 00000100:00100000:2.0:1787786545.240709:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667956736 00000100:00100000:2.0:1787786545.240758:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00100000:2.0:1787786545.240767:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5103290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2361:x1874629667956736:12345-192.168.204.34@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787786545.240847:0:15079:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 7d7927fc-831f-42ff-8d88-89c0cf102351@192.168.204.34@tcp t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:2.0:1787786545.240880:0:15079:0:(genops.c:1385:class_connect()) connect: client 7d7927fc-831f-42ff-8d88-89c0cf102351, cookie 0x450132973bff34ab 00002000:00100000:2.0:1787786545.240894:0:15079:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7d7927fc-831f-42ff-8d88-89c0cf102351/ffff8b5237bd5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113935 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787786545.240928:0:15079:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787786545.241347:0:15079:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787786545.241385:0:15079:0:(import.c:65:import_set_state_nolock()) ffff8b5237bd3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787786545.241691:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5103290000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+6:2361:x1874629667956736:12345-192.168.204.34@tcp:8:mount.lustre.0 Request processed in 922us (1332us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786545.241719:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00100000:0.0:1787786545.246685:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786545.246747:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786545.246849:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667956992 00000100:00100000:3.0:1787786545.246860:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667956992 00000100:00100000:3.0:1787786545.246928:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 0 00000100:00100000:3.0:1787786545.246939:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b435e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+6:13767:x1874629667956992:12345-192.168.204.34@tcp:33:mount.lustre.0 00000004:00080000:0.0:1787786545.248425:0:14396:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1395us 00000100:00100000:1.0:1787786545.248554:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667956864 00000100:00100000:1.0:1787786545.248562:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667956864 00000100:00100000:1.0:1787786545.248609:0:15080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 9 00000100:00100000:1.0:1787786545.248618:0:15080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2361:x1874629667956864:12345-192.168.204.34@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787786545.248649:0:15080:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 7d7927fc-831f-42ff-8d88-89c0cf102351@192.168.204.34@tcp t0 exp 0000000000000000 cur 471 last 0 00000020:00000080:1.0:1787786545.248685:0:15080:0:(genops.c:1385:class_connect()) connect: client 7d7927fc-831f-42ff-8d88-89c0cf102351, cookie 0x450132973bff34b2 00002000:00100000:1.0:1787786545.248701:0:15080:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7d7927fc-831f-42ff-8d88-89c0cf102351/ffff8b52112fc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113935 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787786545.248741:0:15080:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787786545.249497:0:15080:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787786545.249540:0:15080:0:(import.c:65:import_set_state_nolock()) ffff8b52112fd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787786545.250511:0:15080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4343c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d7927fc-831f-42ff-8d88-89c0cf102351+6:2361:x1874629667956864:12345-192.168.204.34@tcp:8:mount.lustre.0 Request processed in 1887us (3834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786545.250523:0:15080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 9 00000004:00200000:3.0:1787786545.278465:0:14396:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1787786545.278660:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b435e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+6:13767:x1874629667956992:12345-192.168.204.34@tcp:33:mount.lustre.0 Request processed in 31717us (31906us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786545.278672:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 0 00010000:00010000:1.0:1787786545.546447:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786545.565927:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786545.566061:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667957120 00000100:00100000:3.0:1787786545.566073:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667957120 00000100:00100000:3.0:1787786545.566151:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00100000:3.0:1787786545.566164:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b434b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d7927fc-831f-42ff-8d88-89c0cf102351+6:13812:x1874629667957120:12345-192.168.204.34@tcp:101:mkdir.0 00010000:00010000:3.0:1787786545.566188:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786545.566219:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff34b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75261f expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786545.566297:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff34c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786545.566319:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff34c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786545.566338:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff34c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786545.566575:0:14395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787786545.566588:0:14395:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787786545.566687:0:14395:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff34c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786545.566717:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff34b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75261f expref: 8 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786545.566733:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff34c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75261f expref: 7 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786545.566741:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5212779300) 00010000:00010000:3.0:1787786545.566744:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787786545.566747:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb7e00, rc 0) 00000100:00100000:3.0:1787786545.566844:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b434b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d7927fc-831f-42ff-8d88-89c0cf102351+7:13812:x1874629667957120:12345-192.168.204.34@tcp:101:mkdir.0 Request processed in 683us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786545.566851:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 8 00010000:00010000:2.0:1787786546.572495:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786546.698584:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686822144:0@lo:400:kworker.0 00000100:00100000:1.0:1787786546.698662:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786546.698724:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b434780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874629686822656:0@lo:400:kworker.0 00000100:00100000:1.0:1787786546.698753:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786546.698778:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787786546.698784:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b436940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686822272:0@lo:400:kworker.0 00000100:00100000:1.0:1787786546.699116:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786546.699147:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686822656 00000100:00100000:1.0:1787786546.699154:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686822656 00000100:00100000:1.0:1787786546.699207:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787786546.699216:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874629686822656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786546.699339:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874629686822656:12345-0@lo:400:kworker.0 Request processed in 123us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786546.699347:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787786546.699437:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787786546.699473:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b434780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874629686822656:0@lo:400:kworker.0 00000100:00100000:1.0:1787786546.699498:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686822144 00000100:00100000:1.0:1787786546.699502:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686822144 00000100:00100000:1.0:1787786546.699533:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686822272 00000100:00100000:1.0:1787786546.699549:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686822272 00000100:00100000:1.0:1787786546.699572:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787786546.699579:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686822144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786546.699615:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686822144:12345-0@lo:400:kworker.0 Request processed in 37us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786546.699621:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787786546.699633:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787786546.699639:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3313:x1874629686822272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786546.699667:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3313:x1874629686822272:12345-0@lo:400:kworker.0 Request processed in 28us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786546.699673:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787786546.699686:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787786546.699689:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787786546.699708:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b436940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686822272:0@lo:400:kworker.0 00000100:00100000:1.0:1787786546.699718:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4361c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686822144:0@lo:400:kworker.0 00000100:00100000:2.0:1787786546.699846:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b436580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3312:1874629686822016:0@lo:400:kworker.0 00000100:00100000:2.0:1787786546.699896:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786546.699922:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874629686822528:0@lo:400:kworker.0 00000100:00100000:2.0:1787786546.699949:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786546.699965:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787786546.700147:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b434f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874629686822400:0@lo:400:kworker.0 00000100:00100000:2.0:1787786546.700172:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786546.700307:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686822528 00000100:00100000:0.0:1787786546.700312:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686822528 00000100:00100000:0.0:1787786546.700343:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686822400 00000100:00100000:0.0:1787786546.700347:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686822400 00000100:00100000:0.0:1787786546.700359:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787786546.700366:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5233338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874629686822528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786546.700538:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5233338000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874629686822528:12345-0@lo:400:kworker.0 Request processed in 171us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786546.700546:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787786546.700559:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787786546.700565:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52333383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874629686822400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786546.700592:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52333383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874629686822400:12345-0@lo:400:kworker.0 Request processed in 28us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786546.700599:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1787786546.700615:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787786546.700637:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b434f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874629686822400:0@lo:400:kworker.0 00000100:00100000:0.0:1787786546.700649:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4352c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874629686822528:0@lo:400:kworker.0 00000100:00100000:1.0:1787786546.701702:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686822016 00000100:00100000:1.0:1787786546.701710:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686822016 00000100:00100000:1.0:1787786546.701748:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787786546.701756:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523baee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+19:3312:x1874629686822016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786546.701852:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523baee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+19:3312:x1874629686822016:12345-0@lo:400:kworker.0 Request processed in 96us (1968us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786546.701859:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1787786546.701901:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787786546.701913:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5233338f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686822784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787786546.701943:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786546.701985:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686822784 00000100:00100000:1.0:1787786546.701998:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686822784 00000100:00100000:1.0:1787786546.702024:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787786546.702030:0:15081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874629686822784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787786546.702058:0:15081:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787786546.702096:0:15081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874629686822784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786546.702103:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787786546.702142:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5233338f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686822784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787786546.702184:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b436580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3312:1874629686822016:0@lo:400:kworker.0 00000001:00100000:2.0:1787786546.798660:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1787786546.798785:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7d7927fc-831f-42ff-8d88-89c0cf102351 00000001:00080000:2.0:1787786546.798928:0:7647:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:1.0:1787786547.576089:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786547.576198:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667957248 00000100:00100000:0.0:1787786547.576219:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667957248 00000100:00100000:0.0:1787786547.576309:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 9 00000100:00100000:0.0:1787786547.576320:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+7:13864:x1874629667957248:12345-192.168.204.34@tcp:41:lfs.0 00000004:00000024:0.0:1787786547.576376:0:14427:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787786547.576477:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+7:13864:x1874629667957248:12345-192.168.204.34@tcp:41:lfs.0 Request processed in 158us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786547.576485:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 9 00000100:00080000:1.0:1787786547.576724:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787786547.579532:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786547.580492:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667957376 00000100:00100000:2.0:1787786547.580504:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667957376 00000100:00100000:2.0:1787786547.580734:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 5 00000100:00100000:2.0:1787786547.580745:0:15081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7d7927fc-831f-42ff-8d88-89c0cf102351+6:13864:x1874629667957376:12345-192.168.204.34@tcp:13:lfs.0 00002000:00000024:2.0:1787786547.580805:0:15081:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787786547.580907:0:15081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7d7927fc-831f-42ff-8d88-89c0cf102351+6:13864:x1874629667957376:12345-192.168.204.34@tcp:13:lfs.0 Request processed in 163us (1384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786547.580915:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 5 00000100:00080000:1.0:1787786547.581132:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787786547.584629:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786547.585085:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667957504 00000100:00100000:2.0:1787786547.585094:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667957504 00000100:00100000:2.0:1787786547.585170:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 6 00000100:00100000:2.0:1787786547.585180:0:15081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7d7927fc-831f-42ff-8d88-89c0cf102351+5:13864:x1874629667957504:12345-192.168.204.34@tcp:13:lfs.0 00002000:00000024:2.0:1787786547.585208:0:15081:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787786547.585304:0:15081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7d7927fc-831f-42ff-8d88-89c0cf102351+5:13864:x1874629667957504:12345-192.168.204.34@tcp:13:lfs.0 Request processed in 126us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786547.585311:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 6 00000100:00080000:0.0:1787786547.585379:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787786547.595343:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786547.798224:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786547.798999:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667957632 00000100:00100000:1.0:1787786547.799013:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667957632 00000100:00100000:1.0:1787786547.799072:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 91 00000100:00100000:1.0:1787786547.799082:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523baed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:380b0949-bde9-4f98-9870-b4d676348301+10:13896:x1874629667957632:12345-192.168.204.34@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787786547.799100:0:14386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786547.799117:0:14386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b523b4d8a00/0x450132973bff34c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752626 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786547.799148:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b523b4d8a00/0x450132973bff34c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752626 expref: 11 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786547.799160:0:14386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b523b4d8a00/0x450132973bff34c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752626 expref: 11 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786547.799200:0:14386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523b4d8a00, rc 0) 00000100:00100000:1.0:1787786547.799261:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523baed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:380b0949-bde9-4f98-9870-b4d676348301+11:13896:x1874629667957632:12345-192.168.204.34@tcp:101:mount.lustre.0 Request processed in 181us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786547.799269:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 91 00000100:00100000:0.0:1787786547.804631:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786547.804713:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667957760 00000100:00100000:3.0:1787786547.804724:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667957760 00000100:00100000:3.0:1787786547.804782:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 92 00000100:00100000:3.0:1787786547.804813:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523baefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:380b0949-bde9-4f98-9870-b4d676348301+11:13896:x1874629667957760:12345-192.168.204.34@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787786547.805243:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523baefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:380b0949-bde9-4f98-9870-b4d676348301+11:13896:x1874629667957760:12345-192.168.204.34@tcp:501:mount.lustre.0 Request processed in 450us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786547.805253:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 92 00000100:00100000:2.0:1787786547.808583:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000001:00100000:1.0:1787786547.808701:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7d7927fc-831f-42ff-8d88-89c0cf102351 00000100:00100000:0.0:1787786547.808819:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667957888 00000100:00100000:0.0:1787786547.808829:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667957888 00000100:00100000:0.0:1787786547.808963:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 93 00000100:00100000:0.0:1787786547.808974:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523baef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:380b0949-bde9-4f98-9870-b4d676348301+11:13896:x1874629667957888:12345-192.168.204.34@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787786547.809503:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523baef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:380b0949-bde9-4f98-9870-b4d676348301+11:13896:x1874629667957888:12345-192.168.204.34@tcp:503:mount.lustre.0 Request processed in 528us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786547.809512:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 93 00000100:00100000:0.0:1787786547.826394:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786547.826505:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667958016 00000100:00100000:1.0:1787786547.826516:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667958016 00000100:00100000:1.0:1787786547.826574:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 94 00000100:00100000:1.0:1787786547.826583:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523baec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:380b0949-bde9-4f98-9870-b4d676348301+11:13903:x1874629667958016:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787786547.827005:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523baec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:380b0949-bde9-4f98-9870-b4d676348301+11:13903:x1874629667958016:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 422us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786547.827014:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 94 00000100:00100000:1.0:1787786547.847627:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786547.847731:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667958144 00000100:00100000:3.0:1787786547.847742:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667958144 00000100:00100000:3.0:1787786547.847835:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 95 00000100:00100000:3.0:1787786547.847847:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523baecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:380b0949-bde9-4f98-9870-b4d676348301+11:13903:x1874629667958144:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787786547.848170:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523baecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:380b0949-bde9-4f98-9870-b4d676348301+11:13903:x1874629667958144:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 324us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786547.848179:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 95 00000100:00100000:2.0:1787786547.852054:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786547.852159:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667958272 00000100:00100000:0.0:1787786547.852168:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667958272 00000100:00100000:0.0:1787786547.852232:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 96 00000100:00100000:0.0:1787786547.852242:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523baee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:380b0949-bde9-4f98-9870-b4d676348301+11:13896:x1874629667958272:12345-192.168.204.34@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787786547.852258:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786547.852275:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b520912ce00/0x450132973bff34ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752650 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786547.852304:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b520912ce00/0x450132973bff34ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752650 expref: 12 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786547.852330:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b520912ce00/0x450132973bff34ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752650 expref: 12 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786547.852339:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912ce00, rc 0) 00000100:00100000:0.0:1787786547.852398:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523baee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:380b0949-bde9-4f98-9870-b4d676348301+12:13896:x1874629667958272:12345-192.168.204.34@tcp:101:mount.lustre.0 Request processed in 158us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786547.852405:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 96 00000100:00100000:0.0:1787786547.857396:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786547.857495:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667958400 00000100:00100000:1.0:1787786547.857507:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667958400 00000100:00100000:1.0:1787786547.857570:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 97 00000100:00100000:1.0:1787786547.857580:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523baed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:380b0949-bde9-4f98-9870-b4d676348301+12:13896:x1874629667958400:12345-192.168.204.34@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787786547.857610:0:14386:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787786547.857634:0:14386:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787786547.857638:0:14386:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787786547.857642:0:14386:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787786547.857645:0:14386:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787786547.861706:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523baed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:380b0949-bde9-4f98-9870-b4d676348301+12:13896:x1874629667958400:12345-192.168.204.34@tcp:256:mount.lustre.0 Request processed in 4116us (4310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786547.861722:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 97 00000100:00100000:2.0:1787786547.869688:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786547.870146:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667958528 00000100:00100000:0.0:1787786547.870157:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667958528 00000100:00100000:0.0:1787786547.870253:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 98 00000100:00100000:0.0:1787786547.870264:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523baeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:380b0949-bde9-4f98-9870-b4d676348301+12:13896:x1874629667958528:12345-192.168.204.34@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787786547.870284:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786547.870301:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b520912c200/0x450132973bff34d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752657 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786547.870329:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b520912c200/0x450132973bff34d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752657 expref: 13 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786547.870339:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b520912c200/0x450132973bff34d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752657 expref: 13 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786547.870357:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912c200, rc 0) 00000100:00100000:0.0:1787786547.870422:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523baeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:380b0949-bde9-4f98-9870-b4d676348301+13:13896:x1874629667958528:12345-192.168.204.34@tcp:101:mount.lustre.0 Request processed in 161us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786547.870429:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 98 00000100:00100000:2.0:1787786547.872125:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786547.873523:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667958656 00000100:00100000:0.0:1787786547.873537:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667958656 00000100:00100000:0.0:1787786547.873844:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 99 00000100:00100000:0.0:1787786547.873855:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523baed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:380b0949-bde9-4f98-9870-b4d676348301+13:13896:x1874629667958656:12345-192.168.204.34@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787786547.874467:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523baed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:380b0949-bde9-4f98-9870-b4d676348301+13:13896:x1874629667958656:12345-192.168.204.34@tcp:501:mount.lustre.0 Request processed in 611us (2347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786547.874477:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 99 00000100:00100000:1.0:1787786547.880641:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786547.880774:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667958784 00000100:00100000:0.0:1787786547.880785:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667958784 00000100:00100000:0.0:1787786547.880927:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 100 00000100:00100000:0.0:1787786547.880938:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523baedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:380b0949-bde9-4f98-9870-b4d676348301+13:13896:x1874629667958784:12345-192.168.204.34@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787786547.881330:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523baedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:380b0949-bde9-4f98-9870-b4d676348301+13:13896:x1874629667958784:12345-192.168.204.34@tcp:503:mount.lustre.0 Request processed in 392us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786547.881339:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 100 00000100:00100000:2.0:1787786547.886558:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786547.886716:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667958912 00000100:00100000:0.0:1787786547.886725:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667958912 00000100:00100000:0.0:1787786547.886774:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 101 00000100:00100000:0.0:1787786547.886784:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523baec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:380b0949-bde9-4f98-9870-b4d676348301+13:13908:x1874629667958912:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787786547.887122:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523baec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:380b0949-bde9-4f98-9870-b4d676348301+13:13908:x1874629667958912:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 338us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786547.887130:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 101 00000100:00100000:2.0:1787786547.891330:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786547.891510:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667959040 00000100:00100000:0.0:1787786547.891534:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667959040 00000100:00100000:0.0:1787786547.891601:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 102 00000100:00100000:0.0:1787786547.891612:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523baec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:380b0949-bde9-4f98-9870-b4d676348301+13:13908:x1874629667959040:12345-192.168.204.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787786547.891918:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523baec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:380b0949-bde9-4f98-9870-b4d676348301+13:13908:x1874629667959040:12345-192.168.204.34@tcp:502:llog_process_th.0 Request processed in 306us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786547.891927:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 102 00000100:00100000:1.0:1787786547.899675:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786547.899731:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667959168 00000100:00100000:3.0:1787786547.899742:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667959168 00000100:00100000:0.0:1787786547.900676:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00100000:0.0:1787786547.900690:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2361:x1874629667959168:12345-192.168.204.34@tcp:38:mount.lustre.0 00010000:00080000:0.0:1787786547.900735:0:14395:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from cfa1d334-bc04-48ef-a4cf-16cdb18f988d@192.168.204.34@tcp t0 exp 0000000000000000 cur 474 last 0 00000020:00000080:0.0:1787786547.900778:0:14395:0:(genops.c:1385:class_connect()) connect: client cfa1d334-bc04-48ef-a4cf-16cdb18f988d, cookie 0x450132973bff34dc 00000004:00100000:0.0:1787786547.900827:0:14395:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1787786547.900983:0:14395:0:(import.c:65:import_set_state_nolock()) ffff8b523a1e7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787786547.901061:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+6:2361:x1874629667959168:12345-192.168.204.34@tcp:38:mount.lustre.0 Request processed in 372us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786547.901069:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00100000:2.0:1787786547.907418:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786547.907637:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667959424 00000100:00100000:0.0:1787786547.907647:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667959424 00000100:00100000:0.0:1787786547.907784:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 11 00000100:00100000:0.0:1787786547.907827:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5233339680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+6:13896:x1874629667959424:12345-192.168.204.34@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787786547.907885:0:14427:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787786547.907967:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5233339680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+6:13896:x1874629667959424:12345-192.168.204.34@tcp:41:mount.lustre.0 Request processed in 142us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786547.907975:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 11 00000100:00080000:1.0:1787786547.909138:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787786547.911676:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786547.911780:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667959296 00000100:00100000:0.0:1787786547.911823:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667959296 00000100:00100000:0.0:1787786547.911913:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00100000:0.0:1787786547.911924:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+6:0:x1874629667959296:12345-192.168.204.34@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787786547.911967:0:14395:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787786547.913891:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+6:0:x1874629667959296:12345-192.168.204.34@tcp:41:mount.lustre.0 Request processed in 1939us (2193us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786547.913906:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00100000:1.0:1787786547.917217:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786547.917578:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667959552 00000100:00100000:0.0:1787786547.917589:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667959552 00000100:00100000:0.0:1787786547.917653:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 13 00000100:00100000:0.0:1787786547.917665:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+6:13896:x1874629667959552:12345-192.168.204.34@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787786547.917745:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+6:13896:x1874629667959552:12345-192.168.204.34@tcp:40:mount.lustre.0 Request processed in 84us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786547.917753:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 13 00000100:00100000:1.0:1787786547.921692:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786547.921766:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667959680 00000100:00100000:2.0:1787786547.921777:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667959680 00000100:00100000:1.0:1787786547.921785:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786547.922188:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786547.922226:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667959936 00000100:00100000:1.0:1787786547.922230:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667959936 00000100:00100000:1.0:1787786547.922266:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 1 00000100:00100000:1.0:1787786547.922276:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101371e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+6:13896:x1874629667959936:12345-192.168.204.34@tcp:33:mount.lustre.0 00000100:00100000:3.0:1787786547.922280:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667959808 00000100:00100000:3.0:1787786547.922284:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667959808 00000100:00100000:2.0:1787786547.922331:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00100000:2.0:1787786547.922336:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b51013703c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2361:x1874629667959680:12345-192.168.204.34@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787786547.922417:0:15079:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from cfa1d334-bc04-48ef-a4cf-16cdb18f988d@192.168.204.34@tcp t0 exp 0000000000000000 cur 474 last 0 00000020:00000080:2.0:1787786547.922631:0:15079:0:(genops.c:1385:class_connect()) connect: client cfa1d334-bc04-48ef-a4cf-16cdb18f988d, cookie 0x450132973bff34e3 00002000:00100000:2.0:1787786547.922643:0:15079:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cfa1d334-bc04-48ef-a4cf-16cdb18f988d/ffff8b5237bd6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113935 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787786547.922654:0:15079:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000004:00200000:1.0:1787786547.922733:0:14397:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787786547.923091:0:15080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 11 00000100:00100000:0.0:1787786547.923097:0:15080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101371680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2361:x1874629667959808:12345-192.168.204.34@tcp:8:mount.lustre.0 00010000:00080000:0.0:1787786547.923113:0:15080:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from cfa1d334-bc04-48ef-a4cf-16cdb18f988d@192.168.204.34@tcp t0 exp 0000000000000000 cur 474 last 0 00000020:00000080:0.0:1787786547.923131:0:15080:0:(genops.c:1385:class_connect()) connect: client cfa1d334-bc04-48ef-a4cf-16cdb18f988d, cookie 0x450132973bff34ea 00002000:00100000:0.0:1787786547.923136:0:15080:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cfa1d334-bc04-48ef-a4cf-16cdb18f988d/ffff8b523a1e1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113935 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787786547.923142:0:15080:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1787786547.923146:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101371e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+6:13896:x1874629667959936:12345-192.168.204.34@tcp:33:mount.lustre.0 Request processed in 873us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786547.923153:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 1 00002000:00080000:0.0:1787786547.923297:0:15080:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787786547.923326:0:15080:0:(import.c:65:import_set_state_nolock()) ffff8b523a1e1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787786547.923374:0:15080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101371680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+6:2361:x1874629667959808:12345-192.168.204.34@tcp:8:mount.lustre.0 Request processed in 275us (1588us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786547.923380:0:15080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 11 00002000:00080000:2.0:1787786547.923838:0:15079:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787786547.923856:0:15079:0:(import.c:65:import_set_state_nolock()) ffff8b5237bd1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787786547.924189:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b51013703c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+6:2361:x1874629667959680:12345-192.168.204.34@tcp:8:mount.lustre.0 Request processed in 1850us (2507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786547.924198:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00100000:1.0:1787786548.140605:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786548.140716:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667960064 00000100:00100000:2.0:1787786548.140728:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667960064 00000100:00100000:2.0:1787786548.140830:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 14 00000100:00100000:2.0:1787786548.140869:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101372940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+6:13929:x1874629667960064:12345-192.168.204.34@tcp:101:mkdir.0 00010000:00010000:2.0:1787786548.140897:0:14393:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786548.140925:0:14393:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9000/0x450132973bff34f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752681 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786548.140992:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8800/0x450132973bff34f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786548.141007:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8800/0x450132973bff34f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786548.141021:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8800/0x450132973bff34f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786548.141216:0:14393:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787786548.141221:0:14393:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787786548.141311:0:14393:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8800/0x450132973bff34f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786548.141341:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9000/0x450132973bff34f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752681 expref: 8 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786548.141360:0:14393:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8800/0x450132973bff34f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752681 expref: 7 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786548.141369:0:14393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5212779300) 00010000:00010000:2.0:1787786548.141372:0:14393:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787786548.141375:0:14393:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523d7a8800, rc 0) 00000100:00100000:2.0:1787786548.141442:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101372940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+7:13929:x1874629667960064:12345-192.168.204.34@tcp:101:mkdir.0 Request processed in 589us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786548.141458:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 14 00010000:00010000:0.0:1787786548.619513:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786548.750566:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523333ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686822912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787786548.750657:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786548.751157:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686822912 00000100:00100000:2.0:1787786548.751166:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686822912 00000100:00100000:2.0:1787786548.751243:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787786548.751254:0:15081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686822912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787786548.751293:0:15081:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787786548.751412:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787786548.751549:0:15081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686822912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 296us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786548.751557:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787786548.754874:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523333ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686822912:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787786549.132443:0:14428:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787786549.642834:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787786550.341306:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cfa1d334-bc04-48ef-a4cf-16cdb18f988d 00000001:00100000:1.0:1787786550.342149:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7d7927fc-831f-42ff-8d88-89c0cf102351 00010000:00010000:1.0:1787786550.668130:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787786550.973642:0:16357:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787786551.690321:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786551.818384:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b51013730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686823040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787786551.818472:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786551.818604:0:15082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686823040 00000100:00100000:1.0:1787786551.818614:0:15082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686823040 00000100:00100000:1.0:1787786551.818689:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787786551.818710:0:15082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686823040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787786551.818750:0:15082:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787786551.818845:0:15082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686823040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786551.818872:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1787786551.819940:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787786551.819986:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787786551.820022:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b51013730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686823040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787786551.822932:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874629686823424:0@lo:400:kworker.0 00000100:00100000:3.0:1787786551.823001:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786551.823171:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3313:1874629686823168:0@lo:400:kworker.0 00000100:00100000:1.0:1787786551.823206:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786551.823247:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686823424 00000100:00100000:1.0:1787786551.823253:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686823424 00000100:00100000:1.0:1787786551.823302:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787786551.823310:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874629686823424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786551.823357:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874629686823424:12345-0@lo:400:kworker.0 Request processed in 47us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786551.823364:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787786551.823389:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874629686823552:0@lo:400:kworker.0 00000100:00100000:1.0:1787786551.823416:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786551.823437:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686823552 00000100:00100000:1.0:1787786551.823440:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686823552 00000100:00100000:1.0:1787786551.823482:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787786551.823489:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101370780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874629686823552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786551.823523:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101370780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874629686823552:12345-0@lo:400:kworker.0 Request processed in 36us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786551.823529:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1787786551.823549:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787786551.823569:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686823168 00000100:00100000:1.0:1787786551.823572:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686823168 00000100:00100000:1.0:1787786551.823597:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787786551.823603:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+19:3313:x1874629686823168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786551.823637:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+19:3313:x1874629686823168:12345-0@lo:400:kworker.0 Request processed in 34us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786551.823655:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787786551.823883:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874629686823424:0@lo:400:kworker.0 00000100:00100000:1.0:1787786551.824249:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3313:1874629686823168:0@lo:400:kworker.0 00000100:00100000:1.0:1787786551.824258:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874629686823680:0@lo:400:kworker.0 00000100:00100000:1.0:1787786551.824289:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786551.824315:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787786551.824321:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686823296:0@lo:400:kworker.0 00000100:00100000:1.0:1787786551.824344:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786551.824365:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686823680 00000100:00100000:1.0:1787786551.824369:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686823680 00000100:00100000:1.0:1787786551.824397:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787786551.824403:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101370f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874629686823680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786551.824438:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101370f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874629686823680:12345-0@lo:400:kworker.0 Request processed in 34us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786551.824444:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1787786551.824474:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787786551.824491:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1874629686823680:0@lo:400:kworker.0 00000100:00100000:0.0:1787786551.824569:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686823296 00000100:00100000:0.0:1787786551.824574:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686823296 00000100:00100000:0.0:1787786551.824617:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787786551.824625:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101372580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686823296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786551.824662:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101372580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686823296:12345-0@lo:400:kworker.0 Request processed in 39us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786551.824668:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1787786551.825340:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787786551.825369:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686823296:0@lo:400:kworker.0 00000100:00100000:3.0:1787786551.828035:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1874629686823552:0@lo:400:kworker.0 00000001:00100000:2.0:1787786551.892005:0:7647:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cfa1d334-bc04-48ef-a4cf-16cdb18f988d 00010000:00010000:1.0:1787786552.723263:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787786552.899232:0:6723:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cfa1d334-bc04-48ef-a4cf-16cdb18f988d 00000100:00100000:1.0:1787786553.272388:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786553.272439:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786553.272473:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786553.272506:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786553.272527:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786553.272586:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786553.272615:0:15614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667960576 00000100:00100000:1.0:1787786553.272625:0:15614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667960576 00000100:00100000:1.0:1787786553.272680:0:15614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667960832 00000100:00100000:1.0:1787786553.272682:0:15614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667960832 00000100:00100000:1.0:1787786553.272696:0:15614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667960448 00000100:00100000:1.0:1787786553.272698:0:15614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667960448 00000100:00100000:1.0:1787786553.272714:0:15614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 5 00000100:00100000:1.0:1787786553.272723:0:15614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101372d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+5:2363:x1874629667960576:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1787786553.272837:0:15614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101372d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+5:2363:x1874629667960576:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 114us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786553.272845:0:15614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 5 00000100:00100000:1.0:1787786553.272863:0:15614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 6 00000100:00100000:1.0:1787786553.272869:0:15614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101370b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+5:2363:x1874629667960832:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1787786553.272895:0:15614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101370b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+5:2363:x1874629667960832:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 26us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786553.272901:0:15614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 6 00000100:00100000:1.0:1787786553.272913:0:15614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:1.0:1787786553.272919:0:15614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b51013712c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+5:2363:x1874629667960448:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1787786553.272941:0:15614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b51013712c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+5:2363:x1874629667960448:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 22us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786553.272960:0:15614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:1.0:1787786553.272981:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667960192 00000100:00100000:1.0:1787786553.272985:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667960192 00000100:00100000:1.0:1787786553.273011:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 104 00000100:00100000:1.0:1787786553.273019:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:380b0949-bde9-4f98-9870-b4d676348301+13:2363:x1874629667960192:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1787786553.273053:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:380b0949-bde9-4f98-9870-b4d676348301+13:2363:x1874629667960192:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 36us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786553.273060:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 104 00000100:00100000:1.0:1787786553.273098:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667960320 00000100:00100000:1.0:1787786553.273102:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667960320 00000100:00100000:1.0:1787786553.273128:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667960704 00000100:00100000:1.0:1787786553.273131:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667960704 00000100:00100000:1.0:1787786553.273149:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 19 00000100:00100000:1.0:1787786553.273156:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+6:2363:x1874629667960320:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1787786553.273185:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101370000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+6:2363:x1874629667960320:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 30us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786553.273192:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 19 00000100:00100000:1.0:1787786553.273203:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 20 00000100:00100000:1.0:1787786553.273209:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101373c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+6:2363:x1874629667960704:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1787786553.273230:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101373c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+6:2363:x1874629667960704:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 22us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786553.273236:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 20 00000100:00080000:1.0:1787786553.273252:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787786553.273256:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787786553.273258:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787786553.285513:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786553.285647:0:15614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667960960 00000100:00100000:3.0:1787786553.285656:0:15614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667960960 00000100:00100000:3.0:1787786553.285720:0:15614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00100000:3.0:1787786553.285730:0:15614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101373480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+5:2363:x1874629667960960:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1787786553.285837:0:15614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101373480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+5:2363:x1874629667960960:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 108us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786553.285858:0:15614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00080000:1.0:1787786553.286110:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787786553.738099:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786553.866581:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5233338f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686823808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787786553.866662:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786553.866972:0:15082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686823808 00000100:00100000:2.0:1787786553.866981:0:15082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686823808 00000100:00100000:2.0:1787786553.867043:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787786553.867054:0:15082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686823808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787786553.867092:0:15082:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787786553.867139:0:15082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4352c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1874629686823808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786553.867147:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1787786553.867662:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787786553.867719:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5233338f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1874629686823808:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787786554.762040:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787786554.844475:0:16507:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe6e2e0410 20000000:00000080:1.0:1787786554.844492:0:16507:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8b51020aac00 uarg=0000000000000000 20000000:01000000:1.0:1787786554.844527:0:16507:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787786554.844537:0:16507:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787786554.844542:0:16507:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787786554.846399:0:16508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1787786554.846569:0:16507:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787786554.857594:0:16507:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787786554.858412:0:16507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8b523b4d8c00/0x450132973bff34ff lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786554.858437:0:16507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b5237aad800/0x450132973bff31f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff31ef expref: 18 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786554.858445:0:16507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b520912c400/0x450132973bff3243 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff323c expref: 18 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786554.858452:0:16507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b523bcb6400/0x450132973bff3377 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff3370 expref: 18 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786554.858460:0:16507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b523d7a9800/0x450132973bff349d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7525f5 expref: 12 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786554.858467:0:16507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8b520912c200/0x450132973bff34d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752657 expref: 12 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786554.858475:0:16507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8b523b4d8c00/0x450132973bff34ff lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786554.858526:0:16507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b520912c200/0x450132973bff34d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752657 expref: 12 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786554.858545:0:16507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b520912c200/0x450132973bff34d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752657 expref: 12 pid: 14388 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786554.858562:0:16507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b51013721c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16507:1874629686823936:192.168.204.34@tcp:104: 00010000:00010000:1.0:1787786554.858702:0:16507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b523d7a9800/0x450132973bff349d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7525f5 expref: 12 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786554.858711:0:16507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b523d7a9800/0x450132973bff349d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7525f5 expref: 12 pid: 14386 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786554.858719:0:16507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5101373840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16507:1874629686824064:192.168.204.34@tcp:104: 00010000:00010000:1.0:1787786554.858777:0:16507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b523bcb6400/0x450132973bff3377 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff3370 expref: 18 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786554.858784:0:16507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b523bcb6400/0x450132973bff3377 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff3370 expref: 18 pid: 14388 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786554.861784:0:16507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b51013730c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16507:1874629686824192:0@lo:104: 00000100:00100000:1.0:1787786554.861878:0:16507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787786554.861943:0:16507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b520912c400/0x450132973bff3243 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff323c expref: 18 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786554.861955:0:16507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b520912c400/0x450132973bff3243 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff323c expref: 18 pid: 14388 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786554.861965:0:16507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bf84b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16507:1874629686824320:0@lo:104: 00000100:00100000:1.0:1787786554.861986:0:16507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787786554.862008:0:16507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8b5237aad800/0x450132973bff31f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x450132973bff31ef expref: 18 pid: 14385 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786554.862017:0:16507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8b5237aad800/0x450132973bff31f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x450132973bff31ef expref: 18 pid: 14385 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786554.862025:0:16507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bf85680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16507:1874629686824448:0@lo:104: 00000100:00100000:1.0:1787786554.862061:0:16507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786554.862072:0:16507:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5206dcd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787786554.862252:0:14376:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787786554.862266:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686824192 00000100:00100000:0.0:1787786554.862273:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686824192 00000100:00100000:0.0:1787786554.862309:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686824320 00000100:00100000:0.0:1787786554.862311:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686824320 00000100:00100000:0.0:1787786554.862321:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686824448 00000100:00100000:0.0:1787786554.862323:0:14376:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686824448 00000100:00100000:0.0:1787786554.862336:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787786554.862344:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101371a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+5:16507:x1874629686824192:12345-0@lo:104: 00010000:00010000:0.0:1787786554.862357:0:14376:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff8b523b4d8200/0x450132973bff3370 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff3377 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786554.862415:0:14376:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787786554.862421:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101371a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+5:16507:x1874629686824192:12345-0@lo:104: Request processed in 78us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786554.862438:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787786554.862455:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787786554.862461:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf85e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+4:16507:x1874629686824320:12345-0@lo:104: 00010000:00010000:0.0:1787786554.862468:0:14376:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff8b52421d5a00/0x450132973bff323c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff3243 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786554.862502:0:14376:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787786554.862507:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf85e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+4:16507:x1874629686824320:12345-0@lo:104: Request processed in 46us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786554.862513:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787786554.862523:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787786554.862528:0:14376:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523d117050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+3:16507:x1874629686824448:12345-0@lo:104: 00010000:00010000:0.0:1787786554.862535:0:14376:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff31ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff31f6 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786554.862555:0:14376:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787786554.862559:0:14376:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523d117050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+3:16507:x1874629686824448:12345-0@lo:104: Request processed in 32us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786554.862564:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1787786554.862596:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787786554.862602:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b523b4d8200/0x450132973bff3370 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff3377 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786554.862609:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8200 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:0.0:1787786554.862612:0:14381:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b523b4d8200/0x450132973bff3370 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff3377 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786554.863191:0:16507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b51013730c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16507:1874629686824192:0@lo:104: 00000100:00100000:1.0:1787786554.863201:0:16507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bf84b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16507:1874629686824320:0@lo:104: 00000100:00100000:1.0:1787786554.863219:0:16507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bf85680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16507:1874629686824448:0@lo:104: 00010000:00010000:0.0:1787786554.863996:0:14381:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b523b4d8200/0x450132973bff3370 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff3377 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787786554.864004:0:14381:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b523b4d8200/0x450132973bff3370 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff3377 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787786554.864011:0:14381:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787786554.864049:0:14381:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b523b4d8200/0x450132973bff3370 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff3377 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786554.864055:0:14381:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787786554.864069:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b523b4d8200/0x450132973bff3370 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff3377 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786554.864077:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b523b4d8200/0x450132973bff3370 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff3377 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786554.864092:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787786554.864095:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b52421d5a00/0x450132973bff323c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff3243 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786554.864101:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b52421d5a00 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:0.0:1787786554.864104:0:14381:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b52421d5a00/0x450132973bff323c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff3243 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786554.864111:0:14381:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b52421d5a00/0x450132973bff323c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff3243 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787786554.864117:0:14381:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b52421d5a00/0x450132973bff323c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff3243 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787786554.864133:0:14381:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787786554.864145:0:14381:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b52421d5a00/0x450132973bff323c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff3243 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786554.864151:0:14381:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787786554.864156:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b52421d5a00/0x450132973bff323c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff3243 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786554.864162:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b52421d5a00/0x450132973bff323c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff3243 expref: -99 pid: 15076 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786554.864170:0:14381:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787786554.864173:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff31ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x450132973bff31f6 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786554.864179:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912d400 already unused, calling callback (ffffffffc1be0c20) 10000000:00010000:0.0:1787786554.864181:0:14381:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff31ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x450132973bff31f6 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786554.864188:0:14381:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff31ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x450132973bff31f6 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787786554.864194:0:14381:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff31ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x450132973bff31f6 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787786554.864199:0:14381:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787786554.864206:0:14381:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff31ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff31f6 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786554.864211:0:14381:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787786554.864361:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff31ef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff31f6 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786554.864369:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff31ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x450132973bff31f6 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786554.864382:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786554.864384:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786554.864386:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786554.864394:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787786554.864419:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b435a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3313:1874629686824832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787786554.864477:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786554.864543:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686824832 00000100:00100000:0.0:1787786554.864549:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686824832 00010000:00010000:0.0:1787786554.864571:0:14378:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b5237aad800/0x450132973bff31f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff31ef expref: 19 pid: 14385 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786554.864595:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787786554.864602:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b436d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+19:3313:x1874629686824832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787786554.864612:0:14378:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787786554.864616:0:14378:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b5237aad800/0x450132973bff31f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff31ef expref: 19 pid: 14385 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786554.864777:0:14378:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b5237aad800/0x450132973bff31f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff31ef expref: 19 pid: 14385 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786554.864960:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b5237aad800/0x450132973bff31f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff31ef expref: 19 pid: 14385 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786554.864973:0:14378:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787786554.865128:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b436d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+18:3313:x1874629686824832:12345-0@lo:103:ldlm_bl.0 Request processed in 524us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786554.865135:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787786554.865648:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3311:1874629686824576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787786554.865686:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786554.865770:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787786554.865778:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3311:1874629686824704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787786554.865835:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786554.866567:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786554.866649:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b435a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3313:1874629686824832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787786554.866695:0:16507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b51013721c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16507:1874629686823936:192.168.204.34@tcp:104: 00000100:00100000:1.0:1787786554.866705:0:16507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5101373840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16507:1874629686824064:192.168.204.34@tcp:104: 00010000:00010000:1.0:1787786554.866746:0:16507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8b523b4d8c00/0x450132973bff34ff lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786554.868543:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786554.869107:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686824576 00000100:00100000:3.0:1787786554.869119:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686824576 00010000:00010000:3.0:1787786554.869157:0:14380:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b523bcb6400/0x450132973bff3377 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff3370 expref: 18 pid: 14388 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786554.869182:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686824704 00000100:00100000:3.0:1787786554.869185:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686824704 00010000:00010000:3.0:1787786554.869199:0:14380:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b520912c400/0x450132973bff3243 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff323c expref: 19 pid: 14388 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786554.869209:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667961088 00000100:00100000:3.0:1787786554.869225:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667961088 00010000:00010000:3.0:1787786554.869241:0:14380:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b520912c200/0x450132973bff34d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752657 expref: 13 pid: 14388 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786554.869252:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667961216 00000100:00100000:3.0:1787786554.869255:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667961216 00010000:00010000:3.0:1787786554.869266:0:14380:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8b523d7a9800/0x450132973bff349d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7525f5 expref: 14 pid: 14386 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786554.869279:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787786554.869286:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+19:3311:x1874629686824576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787786554.869315:0:14380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786554.869322:0:14380:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b523bcb6400/0x450132973bff3377 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff3370 expref: 19 pid: 14388 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786554.869334:0:14380:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b523bcb6400/0x450132973bff3377 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff3370 expref: 19 pid: 14388 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786554.869351:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b523bcb6400/0x450132973bff3377 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff3370 expref: 19 pid: 14388 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786554.869366:0:14380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787786554.869423:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+18:3311:x1874629686824576:12345-0@lo:103:ldlm_bl.0 Request processed in 136us (3736us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786554.869430:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787786554.869449:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787786554.869456:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237b8d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+17:3311:x1874629686824704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787786554.869462:0:14380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786554.869466:0:14380:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b520912c400/0x450132973bff3243 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x450132973bff323c expref: 17 pid: 14388 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786554.869474:0:14380:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b520912c400/0x450132973bff3243 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x450132973bff323c expref: 17 pid: 14388 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786554.869482:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b520912c400/0x450132973bff3243 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x450132973bff323c expref: 17 pid: 14388 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786554.869489:0:14380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787786554.869511:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237b8d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+16:3311:x1874629686824704:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (3676us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786554.869526:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787786554.869569:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:3.0:1787786554.869575:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b437840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380b0949-bde9-4f98-9870-b4d676348301+14:2364:x1874629667961088:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787786554.869582:0:14380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786554.869586:0:14380:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b520912c200/0x450132973bff34d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752657 expref: 14 pid: 14388 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786554.869596:0:14380:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b520912c200/0x450132973bff34d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752657 expref: 14 pid: 14388 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786554.869607:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b520912c200/0x450132973bff34d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752657 expref: 14 pid: 14388 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786554.869615:0:14380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787786554.869656:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b437840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380b0949-bde9-4f98-9870-b4d676348301+13:2364:x1874629667961088:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 81us (3093us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786554.869663:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:3.0:1787786554.869676:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00100000:3.0:1787786554.869682:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b437c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380b0949-bde9-4f98-9870-b4d676348301+12:2364:x1874629667961216:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787786554.869689:0:14380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786554.869693:0:14380:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8b523d7a9800/0x450132973bff349d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7525f5 expref: 12 pid: 14386 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786554.869702:0:14380:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8b523d7a9800/0x450132973bff349d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7525f5 expref: 12 pid: 14386 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786554.869711:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b523d7a9800/0x450132973bff349d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7525f5 expref: 12 pid: 14386 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786554.869747:0:14380:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8b523b4d8c00/0x450132973bff34ff lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786554.869756:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b523b4d8c00/0x450132973bff34ff lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786554.869772:0:14380:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b523b4d8c00/0x450132973bff34ff lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786554.869779:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8b523b4d8c00/0x450132973bff34ff lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786554.869787:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8b523b4d8c00/0x450132973bff34ff lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786554.869938:0:14380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8b523b4d8c00/0x450132973bff34ff lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786554.869945:0:14380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8c00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:3.0:1787786554.869949:0:14380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8b523b4d8c00/0x450132973bff34ff lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786554.869959:0:14380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8b523b4d8c00/0x450132973bff34ff lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786554.869975:0:14380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8b523b4d8c00/0x450132973bff34ff lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786554.869986:0:14380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787786554.870011:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b437c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:380b0949-bde9-4f98-9870-b4d676348301+11:2364:x1874629667961216:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 327us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786554.870025:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00100000:0.0:1787786554.870129:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3311:1874629686824704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787786554.870142:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4370c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3311:1874629686824576:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787786554.870861:0:16507:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8b523b4d8c00/0x450132973bff34ff lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786554.870872:0:16507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8b523b4d8c00/0x450132973bff34ff lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786554.870878:0:16507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8b523b4d8c00/0x450132973bff34ff lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786555.793434:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787786556.041917:0:14390:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787786556.041926:0:14390:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b52329a4000 from 10 10000000:01000000:0.0:1787786556.041932:0:14390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787786556.041984:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff3506 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786556.041996:0:14390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff3506 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786556.042008:0:14390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff3506 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786556.042038:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b434000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686824960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787786556.042130:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786556.042390:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686824960 00000100:00100000:1.0:1787786556.042399:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686824960 00000100:00100000:1.0:1787786556.042451:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787786556.042461:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+16:14390:x1874629686824960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787786556.042474:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786556.042488:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b523b4d8000/0x450132973bff350d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff3506 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786556.042511:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b523b4d8000/0x450132973bff350d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff3506 expref: 17 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786556.042522:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b523b4d8000/0x450132973bff350d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff3506 expref: 17 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786556.042531:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523b4d8000, rc 0) 00000100:00100000:1.0:1787786556.042587:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+17:14390:x1874629686824960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786556.042601:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787786556.042683:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52328bd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787786556.042725:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b434000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686824960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787786556.042740:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff3506 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff350d expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786556.042750:0:14390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff3506 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff350d expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786556.042843:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b434000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686825088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787786556.042871:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786556.042928:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686825088 00000100:00100000:1.0:1787786556.042933:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686825088 00000100:00100000:1.0:1787786556.042961:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787786556.042969:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+17:14390:x1874629686825088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787786556.043248:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+17:14390:x1874629686825088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 268us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786556.043256:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787786556.043783:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52328bd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787786556.044908:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b434000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686825088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787786556.044965:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52333392c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686825216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787786556.045041:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786556.045146:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5211b16000 going to sleep for 11 seconds 00000100:00100000:1.0:1787786556.045528:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686825216 00000100:00100000:1.0:1787786556.045535:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686825216 00000100:00100000:1.0:1787786556.046057:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787786556.046077:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+17:14390:x1874629686825216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787786556.046307:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+17:14390:x1874629686825216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 231us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786556.046315:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787786556.046406:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52333392c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686825216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787786556.051204:0:16538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787786556.051326:0:14390:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787786556.051352:0:14390:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787786556.051365:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff3506 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff350d expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786556.051377:0:14390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b520912d400/0x450132973bff3506 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff350d expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786556.051388:0:14390:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787786556.051391:0:14390:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b52116e0000 from 10 10000000:01000000:3.0:1787786556.051395:0:14390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787786556.051430:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6400/0x450132973bff3514 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786556.051437:0:14390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6400/0x450132973bff3514 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786556.051447:0:14390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6400/0x450132973bff3514 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786556.051472:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686825344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787786556.051542:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786556.051591:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52337ab6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787786556.052338:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686825344 00000100:00100000:2.0:1787786556.052346:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686825344 00000100:00100000:2.0:1787786556.053182:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787786556.053208:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+17:14390:x1874629686825344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787786556.053223:0:14386:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786556.053240:0:14386:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b523d7a8a00/0x450132973bff351b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff3514 expref: -99 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786556.053267:0:14386:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b523d7a8a00/0x450132973bff351b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff3514 expref: 18 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786556.053278:0:14386:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b523d7a8a00/0x450132973bff351b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff3514 expref: 18 pid: 14386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786556.053285:0:14386:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523d7a8a00, rc 0) 00000100:00100000:2.0:1787786556.053351:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+18:14390:x1874629686825344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (1810us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786556.053358:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787786556.053469:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686825344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787786556.053485:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6400/0x450132973bff3514 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff351b expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786556.053494:0:14390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6400/0x450132973bff3514 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff351b expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786556.053556:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b435680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686825472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787786556.053585:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786556.062687:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686825472 00000100:00100000:3.0:1787786556.062712:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686825472 00000100:00100000:3.0:1787786556.062775:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787786556.062784:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+18:14390:x1874629686825472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787786556.063137:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+18:14390:x1874629686825472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 353us (9550us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786556.063154:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1787786556.063383:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52328bd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787786556.063409:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b435680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686825472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787786556.063458:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b435680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686825600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787786556.063503:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786556.063530:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52328bd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787786556.063676:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686825600 00000100:00100000:2.0:1787786556.063682:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686825600 00000100:00100000:1.0:1787786556.069092:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787786556.069129:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+18:14390:x1874629686825600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787786556.069405:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+18:14390:x1874629686825600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 300us (5900us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786556.069413:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787786556.074864:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b435680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686825600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787786556.075735:0:16539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787786556.075975:0:14390:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787786556.075996:0:14390:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787786556.076006:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6400/0x450132973bff3514 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff351b expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786556.076019:0:14390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b523bcb6400/0x450132973bff3514 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff351b expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787786556.076029:0:14390:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787786556.076032:0:14390:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8b51033ae000 from 10 10000000:01000000:3.0:1787786556.076035:0:14390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787786556.076072:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7800/0x450132973bff3522 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786556.076079:0:14390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7800/0x450132973bff3522 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786556.076090:0:14390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7800/0x450132973bff3522 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786556.076112:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686825728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787786556.076177:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786556.076228:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52337ab240 going to sleep for 11 seconds 00000100:00100000:1.0:1787786556.076498:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686825728 00000100:00100000:1.0:1787786556.076506:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686825728 00000100:00100000:1.0:1787786556.076557:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787786556.076767:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+18:14390:x1874629686825728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787786556.076812:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786556.076826:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b523b4d8c00/0x450132973bff3529 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x450132973bff3522 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786556.076850:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b523b4d8c00/0x450132973bff3529 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x450132973bff3522 expref: 19 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786556.076861:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b523b4d8c00/0x450132973bff3529 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x450132973bff3522 expref: 19 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786556.076871:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523b4d8c00, rc 0) 00000100:00100000:1.0:1787786556.076921:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+19:14390:x1874629686825728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786556.076928:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787786556.077100:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686825728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787786556.077115:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7800/0x450132973bff3522 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff3529 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786556.077124:0:14390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7800/0x450132973bff3522 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x450132973bff3529 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786556.077256:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686825856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787786556.077288:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786556.077318:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52337ab240 going to sleep for 11 seconds 00000100:00100000:1.0:1787786556.077359:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686825856 00000100:00100000:1.0:1787786556.077364:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686825856 00000100:00100000:1.0:1787786556.077426:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1787786556.077434:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+19:14390:x1874629686825856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787786556.077728:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+19:14390:x1874629686825856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 294us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786556.077736:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787786556.078595:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686825856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787786556.078648:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b52333392c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686825984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787786556.078726:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786556.085003:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52304e46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787786556.085139:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686825984 00000100:00100000:3.0:1787786556.085149:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686825984 00000100:00100000:3.0:1787786556.085305:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787786556.085314:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+19:14390:x1874629686825984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787786556.085547:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+19:14390:x1874629686825984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 234us (6820us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786556.085556:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787786556.085630:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b52333392c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:14390:1874629686825984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787786556.086619:0:16541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787786556.086685:0:14390:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787786556.086716:0:14390:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787786556.086727:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7800/0x450132973bff3522 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff3529 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786556.086738:0:14390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.134@tcp lock: ffff8b523bcb7800/0x450132973bff3522 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x450132973bff3529 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786556.809993:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786556.857275:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786556.857835:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667961344 00000100:00100000:3.0:1787786556.857846:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667961344 00000100:00100000:3.0:1787786556.857897:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 114 00000100:00100000:3.0:1787786556.857907:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:380b0949-bde9-4f98-9870-b4d676348301+11:13782:x1874629667961344:12345-192.168.204.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787786556.857925:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786556.857957:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b523bcb6a00/0x450132973bff3530 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752688 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786556.857988:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b523bcb6a00/0x450132973bff3530 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752688 expref: 12 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786556.858000:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b523bcb6a00/0x450132973bff3530 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752688 expref: 12 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786556.858009:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb6a00, rc 0) 00000100:00100000:3.0:1787786556.858082:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:380b0949-bde9-4f98-9870-b4d676348301+12:13782:x1874629667961344:12345-192.168.204.34@tcp:101:ll_cfg_requeue.0 Request processed in 176us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786556.858090:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 114 00000100:00100000:1.0:1787786556.878487:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786556.878532:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667961472 00000100:00100000:1.0:1787786556.878541:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667961472 00000100:00100000:1.0:1787786556.878757:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 115 00000100:00100000:1.0:1787786556.878768:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:380b0949-bde9-4f98-9870-b4d676348301+12:13782:x1874629667961472:12345-192.168.204.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787786556.879101:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:380b0949-bde9-4f98-9870-b4d676348301+12:13782:x1874629667961472:12345-192.168.204.34@tcp:501:ll_cfg_requeue.0 Request processed in 334us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786556.879110:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 115 00000100:00100000:0.0:1787786556.882900:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786556.882995:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667961600 00000100:00100000:3.0:1787786556.883004:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667961600 00000100:00100000:3.0:1787786556.883095:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 116 00000100:00100000:3.0:1787786556.883105:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:380b0949-bde9-4f98-9870-b4d676348301+12:13782:x1874629667961600:12345-192.168.204.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787786556.883355:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:380b0949-bde9-4f98-9870-b4d676348301+12:13782:x1874629667961600:12345-192.168.204.34@tcp:503:ll_cfg_requeue.0 Request processed in 250us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786556.883364:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 116 00000100:00100000:3.0:1787786556.899460:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786556.899596:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667961728 00000100:00100000:1.0:1787786556.899606:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667961728 00000100:00100000:1.0:1787786556.899662:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 117 00000100:00100000:1.0:1787786556.899673:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:380b0949-bde9-4f98-9870-b4d676348301+12:13782:x1874629667961728:12345-192.168.204.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787786556.899702:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786556.899721:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8b523b4d8400/0x450132973bff3537 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75268f expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786556.899749:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8b523b4d8400/0x450132973bff3537 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75268f expref: 13 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786556.899761:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8b523b4d8400/0x450132973bff3537 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75268f expref: 13 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786556.899770:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523b4d8400, rc 0) 00000100:00100000:1.0:1787786556.899845:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bff4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:380b0949-bde9-4f98-9870-b4d676348301+13:13782:x1874629667961728:12345-192.168.204.34@tcp:101:ll_cfg_requeue.0 Request processed in 174us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786556.899853:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 117 00000100:00100000:3.0:1787786556.901854:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786556.902263:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667961856 00000100:00100000:1.0:1787786556.902272:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667961856 00000100:00100000:1.0:1787786556.902325:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 118 00000100:00100000:1.0:1787786556.902335:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52329ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:380b0949-bde9-4f98-9870-b4d676348301+13:13782:x1874629667961856:12345-192.168.204.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787786556.902626:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52329ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:380b0949-bde9-4f98-9870-b4d676348301+13:13782:x1874629667961856:12345-192.168.204.34@tcp:501:ll_cfg_requeue.0 Request processed in 291us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786556.902644:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 118 00000100:00100000:0.0:1787786556.910214:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786556.910305:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667961984 00000100:00100000:1.0:1787786556.910315:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667961984 00000100:00100000:1.0:1787786556.910378:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 119 00000100:00100000:1.0:1787786556.910387:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52329aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:380b0949-bde9-4f98-9870-b4d676348301+13:13782:x1874629667961984:12345-192.168.204.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787786556.910638:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52329aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:380b0949-bde9-4f98-9870-b4d676348301+13:13782:x1874629667961984:12345-192.168.204.34@tcp:503:ll_cfg_requeue.0 Request processed in 250us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786556.910645:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 119 00000100:00100000:3.0:1787786556.940396:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787786556.940420:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686826112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787786556.940489:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786556.940989:0:15082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686826112 00000100:00100000:2.0:1787786556.941000:0:15082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686826112 00000100:00100000:2.0:1787786556.941070:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787786556.941081:0:15082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686826112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787786556.941133:0:15082:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787786556.941186:0:15082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686826112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786556.941193:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787786556.941610:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b435a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874629686826624:0@lo:400:kworker.0 00000100:00100000:0.0:1787786556.941648:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786556.941676:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787786556.941682:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b436d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686826496:0@lo:400:kworker.0 00000100:00100000:0.0:1787786556.941717:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786556.941745:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b434f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686826368:0@lo:400:kworker.0 00000100:00100000:3.0:1787786556.942065:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3311:1874629686826240:0@lo:400:kworker.0 00000100:00100000:3.0:1787786556.942100:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786556.942136:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b436580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874629686826752:0@lo:400:kworker.0 00000100:00100000:3.0:1787786556.942159:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786556.942205:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686826624 00000100:00100000:3.0:1787786556.942211:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686826624 00000100:00100000:3.0:1787786556.942248:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686826496 00000100:00100000:3.0:1787786556.942251:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686826496 00000100:00100000:3.0:1787786556.942262:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686826752 00000100:00100000:3.0:1787786556.942264:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686826752 00000100:00100000:3.0:1787786556.942279:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787786556.942286:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874629686826624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786556.942332:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4361c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1874629686826624:12345-0@lo:400:kworker.0 Request processed in 45us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786556.942338:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787786556.942355:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787786556.942362:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b436940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686826496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786556.942389:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b436940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1874629686826496:12345-0@lo:400:kworker.0 Request processed in 28us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786556.942394:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787786556.942406:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787786556.942413:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874629686826752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786556.942443:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874629686826752:12345-0@lo:400:kworker.0 Request processed in 31us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786556.942448:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787786556.942480:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b436580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1874629686826752:0@lo:400:kworker.0 00000100:00100000:0.0:1787786556.942681:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787786556.942738:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787786556.942743:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787786556.943036:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b436d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1874629686826496:0@lo:400:kworker.0 00000100:00100000:0.0:1787786556.943054:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b435a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1874629686826624:0@lo:400:kworker.0 00000100:00100000:0.0:1787786556.943096:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686826112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787786556.943334:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686826240 00000100:00100000:2.0:1787786556.943340:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686826240 00000100:00100000:2.0:1787786556.943379:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787786556.943386:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52329ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+19:3311:x1874629686826240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786556.943441:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52329ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+19:3311:x1874629686826240:12345-0@lo:400:kworker.0 Request processed in 55us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786556.943448:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1787786556.943495:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b434000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3311:1874629686826240:0@lo:400:kworker.0 00000100:00100000:3.0:1787786556.944778:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686826368 00000100:00100000:3.0:1787786556.944806:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686826368 00000100:00100000:3.0:1787786556.944876:0:15080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787786556.944905:0:15080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b434780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686826368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787786556.945453:0:15080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b434780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686826368:12345-0@lo:400:kworker.0 Request processed in 549us (2769us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786556.945462:0:15080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787786556.945520:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b434f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686826368:0@lo:400:kworker.0 00000100:00080000:2.0:1787786556.946928:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787786557.834817:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786558.387983:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786558.388044:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786558.388091:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786558.388122:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786558.388142:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786558.388162:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786558.388196:0:14385:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667962112 00000100:00100000:2.0:1787786558.388212:0:14385:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667962112 00000100:00100000:2.0:1787786558.388276:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 121 00000100:00100000:2.0:1787786558.388286:0:14385:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52329a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:380b0949-bde9-4f98-9870-b4d676348301+13:2363:x1874629667962112:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786558.388365:0:14385:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52329a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:380b0949-bde9-4f98-9870-b4d676348301+13:2363:x1874629667962112:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 80us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786558.388374:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 121 00000100:00100000:3.0:1787786558.388411:0:15614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667962368 00000100:00100000:3.0:1787786558.388421:0:15614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667962368 00000100:00100000:2.0:1787786558.388471:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667962880 00000100:00100000:2.0:1787786558.388478:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667962880 00000100:00100000:3.0:1787786558.388495:0:15614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667962496 00000100:00100000:3.0:1787786558.388501:0:15614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667962496 00000100:00100000:3.0:1787786558.388542:0:15614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00100000:3.0:1787786558.388551:0:15614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+5:2363:x1874629667962368:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1787786558.388601:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667962624 00000100:00100000:0.0:1787786558.388620:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667962624 00000100:00100000:0.0:1787786558.388669:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667962240 00000100:00100000:0.0:1787786558.388672:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667962240 00000100:00100000:0.0:1787786558.388710:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 24 00000100:00100000:0.0:1787786558.388719:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+6:2363:x1874629667962624:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:1.0:1787786558.389589:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786558.389928:0:15614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+5:2363:x1874629667962368:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 1374us (1879us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786558.390467:0:15080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 11 00000100:00100000:2.0:1787786558.390491:0:15080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+5:2363:x1874629667962880:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786558.390556:0:15080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+5:2363:x1874629667962880:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 76us (2432us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786558.390643:0:15080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 11 00000100:00100000:1.0:1787786558.390686:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 25 00000100:00100000:2.0:1787786558.390692:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667962752 00000100:00100000:2.0:1787786558.390701:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667962752 00000100:00100000:1.0:1787786558.390710:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+6:2363:x1874629667962240:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786558.390750:0:15080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00100000:2.0:1787786558.390764:0:15080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d7927fc-831f-42ff-8d88-89c0cf102351+5:2363:x1874629667962496:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1787786558.390907:0:15614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00100000:3.0:1787786558.390937:0:15614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 13 00000100:00100000:3.0:1787786558.390949:0:15614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+5:2363:x1874629667962752:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786558.391069:0:15080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d7927fc-831f-42ff-8d88-89c0cf102351+5:2363:x1874629667962496:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 307us (2904us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786558.391078:0:15080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00080000:2.0:1787786558.391111:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787786558.391115:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787786558.391118:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787786558.391465:0:15614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+5:2363:x1874629667962752:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 516us (1878us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786558.391476:0:15614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 13 00000100:00100000:1.0:1787786558.393592:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf86940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+6:2363:x1874629667962240:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 2876us (5430us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786558.393612:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 25 00000100:00100000:0.0:1787786558.394117:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+6:2363:x1874629667962624:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 5386us (6022us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786558.394132:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 24 00000100:00100000:1.0:1787786558.684042:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786558.684300:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667963008 00000100:00100000:3.0:1787786558.684310:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667963008 00000100:00100000:3.0:1787786558.684559:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 15 00000100:00100000:3.0:1787786558.684571:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d7927fc-831f-42ff-8d88-89c0cf102351+6:14440:x1874629667963008:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787786558.684592:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786558.684612:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff353e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752696 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.684704:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff3545 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.684717:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff3545 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.684729:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff3545 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.684844:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff354c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.684854:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff354c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.684862:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff354c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.685600:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff3553 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.685613:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff3553 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.685621:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff3553 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786558.685716:0:14395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787786558.685720:0:14395:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787786558.687629:0:14395:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff3553 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.687671:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff3545 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.687678:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff3545 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.687685:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff3545 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.687690:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb6200 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786558.687694:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff3545 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.687701:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff3545 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.687716:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5212779300) 00010000:00010000:3.0:1787786558.687719:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786558.687723:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff3545 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.687729:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff3545 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.688385:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff354c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.688478:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff354c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.688485:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff354c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.688500:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7a00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786558.688503:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff354c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.688510:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff354c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.688521:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8b5212779500) 00010000:00010000:3.0:1787786558.688525:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786558.688528:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff354c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.688534:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff354c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.688590:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff353e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752696 expref: 8 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.688605:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6800/0x450132973bff3553 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752696 expref: 7 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.688612:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8b5212779a00) 00010000:00010000:3.0:1787786558.688614:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787786558.688617:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb6800, rc 0) 00000100:00100000:3.0:1787786558.688720:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d7927fc-831f-42ff-8d88-89c0cf102351+7:14440:x1874629667963008:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 4149us (4684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786558.688729:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 15 00000100:00100000:2.0:1787786558.695843:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786558.696103:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667963264 00000100:00100000:0.0:1787786558.696113:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667963264 00000100:00100000:0.0:1787786558.696184:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 16 00000100:00100000:0.0:1787786558.696194:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523333a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+7:14440:x1874629667963264:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787786558.696215:0:14393:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786558.696240:0:14393:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff355a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75269d expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.696569:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ca00/0x450132973bff3561 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.696585:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ca00/0x450132973bff3561 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.696597:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ca00/0x450132973bff3561 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.696640:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c800/0x450132973bff3568 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.696648:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c800/0x450132973bff3568 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.696666:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c800/0x450132973bff3568 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.699132:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff356f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.699168:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff356f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.699193:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff356f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787786558.699209:0:14393:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787786558.701640:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ca00/0x450132973bff3561 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.701669:0:14393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ca00/0x450132973bff3561 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.701677:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ca00/0x450132973bff3561 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.701684:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912ca00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786558.701688:0:14393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ca00/0x450132973bff3561 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.701695:0:14393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ca00/0x450132973bff3561 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.701710:0:14393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8b5212779a00) 00010000:00010000:0.0:1787786558.701713:0:14393:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786558.701717:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ca00/0x450132973bff3561 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.701723:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ca00/0x450132973bff3561 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.703042:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c800/0x450132973bff3568 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.703063:0:14393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c800/0x450132973bff3568 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.703092:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c800/0x450132973bff3568 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.703098:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912c800 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786558.703102:0:14393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c800/0x450132973bff3568 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.703110:0:14393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c800/0x450132973bff3568 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.703125:0:14393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8b5222ae8300) 00010000:00010000:0.0:1787786558.703128:0:14393:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786558.703132:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c800/0x450132973bff3568 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.704088:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c800/0x450132973bff3568 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.712613:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff355a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75269d expref: 10 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.712643:0:14393:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d200/0x450132973bff356f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75269d expref: 9 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.712665:0:14393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b5222ae8200) 00010000:00010000:0.0:1787786558.712668:0:14393:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786558.712673:0:14393:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912d200, rc 0) 00000100:00100000:0.0:1787786558.713231:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523333a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+9:14440:x1874629667963264:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 17035us (17437us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787786558.713257:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 16 00000100:00100000:0.0:1787786558.723253:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786558.723358:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667963392 00000100:00100000:3.0:1787786558.723380:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667963392 00000100:00100000:3.0:1787786558.723454:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 17 00000100:00100000:3.0:1787786558.723464:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b435a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+9:14440:x1874629667963392:12345-192.168.204.34@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787786558.723578:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b435a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+9:14440:x1874629667963392:12345-192.168.204.34@tcp:59:lhsmtool_posix.0 Request processed in 115us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786558.723586:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 17 00000100:00100000:2.0:1787786558.799849:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786558.803735:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667963520 00000100:00100000:3.0:1787786558.803753:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667963520 00000100:00100000:3.0:1787786558.803836:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 18 00000100:00100000:3.0:1787786558.803847:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523333a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+9:14446:x1874629667963520:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:3.0:1787786558.803866:0:14394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786558.803885:0:14394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff357d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7526a4 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.803947:0:14394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff3584 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.803963:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff3584 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.803973:0:14394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff3584 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.803988:0:14394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff358b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.803995:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff358b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.804001:0:14394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff358b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.805501:0:14394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff3584 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.805516:0:14394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff3584 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.805524:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff3584 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.805530:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7a00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786558.805534:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff3584 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.805541:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff3584 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.805559:0:14394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5212779300) 00010000:00010000:3.0:1787786558.805562:0:14394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786558.805566:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff3584 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.805573:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff3584 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.805585:0:14394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff358b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.805592:0:14394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff358b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.805598:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff358b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.805611:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb6200 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786558.805614:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff358b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.805621:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff358b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.805629:0:14394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8b5212779500) 00010000:00010000:3.0:1787786558.805631:0:14394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786558.805634:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff358b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.805640:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff358b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.805697:0:14394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff357d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526a4 expref: 10 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.805708:0:14394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5212779300) 00010000:00010000:3.0:1787786558.805710:0:14394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786558.805714:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff357d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526a4 expref: 10 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.805722:0:14394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb7600, rc 0) 00000100:00100000:3.0:1787786558.806366:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523333a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+9:14446:x1874629667963520:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 1944us (5950us total) trans 0 rc 301/301 00000100:00100000:3.0:1787786558.806380:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 18 00000100:00100000:1.0:1787786558.810196:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786558.810289:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667963648 00000100:00100000:3.0:1787786558.810311:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667963648 00000100:00100000:3.0:1787786558.810372:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 0 00000100:00100000:3.0:1787786558.810382:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7d7927fc-831f-42ff-8d88-89c0cf102351+9:14446:x1874629667963648:12345-192.168.204.34@tcp:700:lfs.0 00000100:00100000:3.0:1787786558.810463:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7d7927fc-831f-42ff-8d88-89c0cf102351+9:14446:x1874629667963648:12345-192.168.204.34@tcp:700:lfs.0 Request processed in 82us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786558.810471:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 0 00000100:00100000:0.0:1787786558.826665:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786558.827450:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667963904 00000100:00100000:3.0:1787786558.827464:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667963904 00000100:00100000:3.0:1787786558.827532:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 19 00000100:00100000:3.0:1787786558.827542:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b436d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+9:14446:x1874629667963904:12345-192.168.204.34@tcp:36:lfs.0 00010000:00010000:3.0:1787786558.827602:0:14427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786558.827631:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff34c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75261f expref: 9 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.827661:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5212779300) 00010000:00010000:3.0:1787786558.827667:0:14427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787786558.828338:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff3592 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.828357:0:14427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8800/0x450132973bff34f8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752681 expref: 5 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.828366:0:14427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff3592 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.828403:0:14427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8800/0x450132973bff34f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752681 expref: 5 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786558.828432:0:14427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8800/0x450132973bff34f8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752681 expref: 5 pid: 14393 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786558.828447:0:14427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d4780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14427:1874629686826880:192.168.204.34@tcp:104: 00000100:00100000:3.0:1787786558.828787:0:14427:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52103a4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787786558.833568:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786558.833663:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667964032 00000100:00100000:0.0:1787786558.833672:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667964032 00010000:00010000:0.0:1787786558.833713:0:14380:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8800/0x450132973bff34f8 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752681 expref: 6 pid: 14393 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786558.833767:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 9 00000100:00100000:0.0:1787786558.833777:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+6:2364:x1874629667964032:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787786558.833810:0:14380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787786558.833818:0:14380:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8800/0x450132973bff34f8 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752681 expref: 6 pid: 14393 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.833833:0:14380:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8800/0x450132973bff34f8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752681 expref: 6 pid: 14393 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.833857:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5212779300) 00010000:00010000:0.0:1787786558.833863:0:14380:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff3592 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.833873:0:14380:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff3592 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.833881:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff3592 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.833901:0:14380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787786558.833985:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf852c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+6:2364:x1874629667964032:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 209us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786558.833993:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 9 00010000:00010000:3.0:1787786558.835482:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8800/0x450132973bff34f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752681 expref: 5 pid: 14393 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786558.835512:0:14427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d4780 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14427:1874629686826880:192.168.204.34@tcp:104: 00010000:00010000:3.0:1787786558.835536:0:14427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff3592 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786558.835664:0:14427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff3592 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786558.835690:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff3592 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786558.835717:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff3599 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786558.835729:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff3599 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786558.836011:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff3599 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787786558.838334:0:14427:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1787786558.838356:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff3592 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786558.838366:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff3592 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786558.838375:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff3592 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786558.838380:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7600 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786558.838385:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff3592 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786558.838393:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff3592 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786558.838410:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5212779300) 00010000:00010000:1.0:1787786558.838413:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787786558.838428:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff3592 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786558.838434:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7600/0x450132973bff3592 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787786558.838459:0:14427:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000056161446 reply state 000000001bebb792 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff3599 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786558.838468:0:14427:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787786558.838667:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b436d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+10:14446:x1874629667963904:12345-192.168.204.34@tcp:36:lfs.0 Request processed in 11122us (12019us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1787786558.838676:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 19 00010000:00010000:2.0:1787786558.845109:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff3599 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.845127:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff3599 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.845136:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff3599 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.845152:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d9200 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786558.845158:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff3599 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.845167:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff3599 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.845204:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8b52100f1200) 00010000:00010000:2.0:1787786558.845207:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786558.845212:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff3599 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.845219:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9200/0x450132973bff3599 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.858166:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786558.944371:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786558.946301:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667964160 00000100:00100000:0.0:1787786558.946316:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667964160 00000100:00100000:0.0:1787786558.946440:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 20 00000100:00100000:0.0:1787786558.946452:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+9:14454:x1874629667964160:12345-192.168.204.34@tcp:101:lctl.0 00010000:00010000:0.0:1787786558.946477:0:14393:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786558.946502:0:14393:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ca00/0x450132973bff35a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7526ab expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.946574:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff35a7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.946588:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff35a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.946600:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff35a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787786558.946673:0:14393:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787786558.946677:0:14393:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1787786558.946726:0:14393:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff35a7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.946753:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ca00/0x450132973bff35a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526ab expref: 11 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.946771:0:14393:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c600/0x450132973bff35a7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526ab expref: 10 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786558.946838:0:14393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5222ae8300) 00010000:00010000:0.0:1787786558.946841:0:14393:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787786558.946844:0:14393:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912c600, rc 0) 00000100:00100000:0.0:1787786558.946920:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+10:14454:x1874629667964160:12345-192.168.204.34@tcp:101:lctl.0 Request processed in 470us (2558us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786558.946927:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 20 00000100:00100000:1.0:1787786558.980086:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786558.980245:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667964288 00000100:00100000:2.0:1787786558.980255:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667964288 00000100:00100000:2.0:1787786558.980365:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 21 00000100:00100000:2.0:1787786558.980377:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+5:14456:x1874629667964288:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:2.0:1787786558.980398:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786558.980419:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9200/0x450132973bff35ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7526b2 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.980484:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9800/0x450132973bff35b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.980498:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9800/0x450132973bff35b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.980510:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9800/0x450132973bff35b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786558.980574:0:14395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787786558.980578:0:14395:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1787786558.980605:0:14395:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9800/0x450132973bff35b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.980659:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9200/0x450132973bff35ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526b2 expref: 7 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.980679:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9800/0x450132973bff35b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526b2 expref: 6 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.980688:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5222ae8300) 00010000:00010000:2.0:1787786558.980691:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787786558.980694:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523d7a9800, rc 0) 00000100:00100000:2.0:1787786558.980784:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+6:14456:x1874629667964288:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 410us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786558.980844:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 21 00000100:00100000:1.0:1787786558.988714:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786558.988924:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667964416 00000100:00100000:2.0:1787786558.988940:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667964416 00000100:00100000:2.0:1787786558.989014:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 22 00000100:00100000:2.0:1787786558.989031:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+6:14456:x1874629667964416:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:2.0:1787786558.989058:0:14394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786558.989084:0:14394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9200/0x450132973bff35bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7526b9 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.989188:0:14394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8c00/0x450132973bff35c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.989210:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8c00/0x450132973bff35c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.989227:0:14394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8c00/0x450132973bff35c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.989272:0:14394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff35ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.989283:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff35ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.989294:0:14394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff35ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.989574:0:14394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8000/0x450132973bff35d1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.989587:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8000/0x450132973bff35d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.989597:0:14394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8000/0x450132973bff35d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786558.989662:0:14394:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787786558.989669:0:14394:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787786558.989710:0:14394:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8000/0x450132973bff35d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.989728:0:14394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8c00/0x450132973bff35c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786558.990119:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787786558.990148:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686827008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787786558.990212:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786558.990296:0:15082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686827008 00000100:00100000:3.0:1787786558.990302:0:15082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686827008 00010000:00010000:2.0:1787786558.990327:0:14394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8c00/0x450132973bff35c3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.990334:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8c00/0x450132973bff35c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786558.990355:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787786558.990368:0:15082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686827008:12345-0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787786558.990372:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523d7a8c00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786558.990378:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8c00/0x450132973bff35c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00000024:3.0:1787786558.990399:0:15082:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787786558.990453:0:15082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874629686827008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786558.990461:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1787786558.990492:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787786558.990553:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1874629686827008:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787786558.991005:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8c00/0x450132973bff35c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.991019:0:14394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5222ae8300) 00010000:00010000:2.0:1787786558.991022:0:14394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786558.991027:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8c00/0x450132973bff35c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.991033:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8c00/0x450132973bff35c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.991048:0:14394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff35ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.991054:0:14394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff35ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.991060:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff35ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.991065:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523d7a8400 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786558.991068:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff35ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.991073:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff35ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.991091:0:14394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8b52112ada00) 00010000:00010000:2.0:1787786558.991093:0:14394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786558.991095:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff35ca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.991100:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff35ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.991139:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9200/0x450132973bff35bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526b9 expref: 8 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.991153:0:14394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8000/0x450132973bff35d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526b9 expref: 7 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.991379:0:14394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8b52112ad900) 00010000:00010000:2.0:1787786558.991383:0:14394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787786558.991386:0:14394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523d7a8000, rc 0) 00000100:00100000:2.0:1787786558.991912:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+7:14456:x1874629667964416:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 2885us (3210us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786558.991922:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 22 00000100:00100000:0.0:1787786558.998189:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786558.998325:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667964672 00000100:00100000:2.0:1787786558.998336:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667964672 00000100:00100000:2.0:1787786558.998397:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 23 00000100:00100000:2.0:1787786558.998408:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+7:14456:x1874629667964672:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:2.0:1787786558.998429:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786558.998450:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9a00/0x450132973bff35d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7526c0 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786558.998588:0:14427:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787786558.998728:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9a00/0x450132973bff35d8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526c0 expref: 9 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.998753:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5222ae8300) 00010000:00010000:2.0:1787786558.998756:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787786558.998762:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9a00/0x450132973bff35d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526c0 expref: 9 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786558.998777:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523d7a9a00, rc 0) 00000100:00100000:2.0:1787786558.998873:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b437480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+8:14456:x1874629667964672:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 467us (695us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1787786558.998880:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 23 00000100:00100000:0.0:1787786559.008066:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786559.009405:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667964928 00000100:00100000:1.0:1787786559.009419:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667964928 00000100:00100000:1.0:1787786559.009487:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 24 00000100:00100000:1.0:1787786559.009498:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b435680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+8:14456:x1874629667964928:12345-192.168.204.34@tcp:36:lfs.0 00010000:00010000:1.0:1787786559.009556:0:14393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786559.009583:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8000/0x450132973bff35d1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526b9 expref: 8 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.009602:0:14393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8b52112ad900) 00010000:00010000:1.0:1787786559.009612:0:14393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787786559.009635:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9600/0x450132973bff35e6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.009659:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9600/0x450132973bff35e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.009685:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9600/0x450132973bff35e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787786559.009950:0:14393:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000364f137f reply state 00000000a5925cf0 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9600/0x450132973bff35e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786559.009962:0:14393:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787786559.009978:0:14393:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:3.0:1787786559.010150:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b435680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+9:14456:x1874629667964928:12345-192.168.204.34@tcp:36:lfs.0 Request processed in 652us (2093us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1787786559.010159:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 24 00010000:00010000:3.0:1787786559.016335:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9600/0x450132973bff35e6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.016357:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9600/0x450132973bff35e6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.016365:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9600/0x450132973bff35e6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.016371:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d9600 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786559.016377:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9600/0x450132973bff35e6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.016386:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9600/0x450132973bff35e6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.017336:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8b52100f1300) 00010000:00010000:3.0:1787786559.017344:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787786559.017361:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9600/0x450132973bff35e6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.017370:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9600/0x450132973bff35e6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786559.019485:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786559.020136:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667965184 00000100:00100000:1.0:1787786559.020276:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667965184 00000100:00100000:1.0:1787786559.020473:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 2 00000100:00100000:1.0:1787786559.020486:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b434f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+8:14456:x1874629667965184:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:1.0:1787786559.021657:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b434f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+9:14456:x1874629667965184:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 1156us (2161us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787786559.021668:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 2 00000100:00100000:0.0:1787786559.025868:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786559.025998:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667965440 00000100:00100000:2.0:1787786559.026008:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667965440 00000100:00100000:2.0:1787786559.026080:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 25 00000100:00100000:2.0:1787786559.026091:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+9:14456:x1874629667965440:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:2.0:1787786559.026124:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786559.026154:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9a00/0x450132973bff35ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7526c7 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.026247:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9200/0x450132973bff35f4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.026262:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9200/0x450132973bff35f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.026291:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9200/0x450132973bff35f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.026305:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff35fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.026312:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff35fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.026320:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff35fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786559.026465:0:14427:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787786559.026580:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9200/0x450132973bff35f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.026592:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9200/0x450132973bff35f4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.026598:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9200/0x450132973bff35f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.026605:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523d7a9200 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786559.026609:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9200/0x450132973bff35f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.026616:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9200/0x450132973bff35f4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.026632:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5222ae8300) 00010000:00010000:2.0:1787786559.026635:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786559.026660:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9200/0x450132973bff35f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.026667:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9200/0x450132973bff35f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.026689:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff35fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.026696:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff35fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.026705:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff35fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.026710:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523d7a8400 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786559.026713:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff35fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.026722:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff35fb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.026733:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8b52112ada00) 00010000:00010000:2.0:1787786559.026736:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786559.026738:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff35fb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.026753:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff35fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.026851:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9a00/0x450132973bff35ed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526c7 expref: 11 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.026881:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5222ae8300) 00010000:00010000:2.0:1787786559.026884:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787786559.026891:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9a00/0x450132973bff35ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526c7 expref: 11 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.026902:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523d7a9a00, rc 0) 00000100:00100000:2.0:1787786559.026971:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b434000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+10:14456:x1874629667965440:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 879us (1111us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1787786559.026980:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 25 00000100:00100000:0.0:1787786559.031245:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786559.031394:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667965568 00000100:00100000:3.0:1787786559.031404:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667965568 00000100:00100000:3.0:1787786559.031465:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 26 00000100:00100000:3.0:1787786559.031474:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b436580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+10:14456:x1874629667965568:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:3.0:1787786559.031515:0:14393:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786559.031539:0:14393:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff3609 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7526ce expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.031628:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff3610 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.031643:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff3610 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.031664:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff3610 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786559.031715:0:14393:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787786559.031719:0:14393:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787786559.031746:0:14393:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff3610 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.031772:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff3609 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526ce expref: 12 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.031823:0:14393:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff3610 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526ce expref: 11 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.031834:0:14393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8b5212779500) 00010000:00010000:3.0:1787786559.031837:0:14393:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787786559.031840:0:14393:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb6200, rc 0) 00000100:00100000:3.0:1787786559.031897:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b436580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+11:14456:x1874629667965568:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 424us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786559.031905:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 26 00000100:00100000:0.0:1787786559.039028:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786559.039125:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667965696 00000100:00100000:2.0:1787786559.039135:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667965696 00000100:00100000:2.0:1787786559.039201:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 3 00000100:00100000:2.0:1787786559.039212:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+11:14456:x1874629667965696:12345-192.168.204.34@tcp:37:lfs.0 00000100:00100000:2.0:1787786559.045545:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4370c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+11:14456:x1874629667965696:12345-192.168.204.34@tcp:37:lfs.0 Request processed in 6324us (6518us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786559.045558:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 3 00000100:00100000:0.0:1787786559.054863:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786559.055008:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667965952 00000100:00100000:1.0:1787786559.055018:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667965952 00000100:00100000:1.0:1787786559.055078:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 4 00000100:00100000:1.0:1787786559.055088:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5233320850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+11:14456:x1874629667965952:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:1.0:1787786559.055407:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5233320850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+12:14456:x1874629667965952:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 319us (552us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787786559.055416:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 4 00000100:00100000:0.0:1787786559.157022:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786559.157112:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667966080 00000100:00100000:3.0:1787786559.157122:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667966080 00000100:00100000:3.0:1787786559.157249:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 27 00000100:00100000:3.0:1787786559.157261:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b435e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d7927fc-831f-42ff-8d88-89c0cf102351+10:14462:x1874629667966080:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:3.0:1787786559.157281:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786559.157302:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff3617 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7526d5 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.157374:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff361e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.157391:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff361e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.157403:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff361e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.157418:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff3625 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.157425:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff3625 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.157431:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff3625 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.157553:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6600/0x450132973bff362c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.157563:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6600/0x450132973bff362c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.157590:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6600/0x450132973bff362c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786559.157624:0:14395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787786559.157628:0:14395:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787786559.157682:0:14395:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6600/0x450132973bff362c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.157694:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff361e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.157701:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff361e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.157708:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff361e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.157715:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7a00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786559.157719:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff361e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.158853:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff361e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.158878:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5222ae8300) 00010000:00010000:3.0:1787786559.158882:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786559.158888:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff361e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.158896:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7a00/0x450132973bff361e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.158930:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff3625 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.158936:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff3625 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.158942:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff3625 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.158948:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7c00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786559.158951:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff3625 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.158958:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff3625 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.158966:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8b5212779400) 00010000:00010000:3.0:1787786559.158968:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786559.158971:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff3625 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.158977:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff3625 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.159019:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff3617 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526d5 expref: 12 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.159033:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6600/0x450132973bff362c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526d5 expref: 11 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.159053:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8b5212779500) 00010000:00010000:3.0:1787786559.159055:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787786559.159058:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb6600, rc 0) 00000100:00100000:3.0:1787786559.159136:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b435e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7d7927fc-831f-42ff-8d88-89c0cf102351+11:14462:x1874629667966080:12345-192.168.204.34@tcp:101:bash.0 Request processed in 1877us (2123us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786559.159146:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 27 00000100:00100000:0.0:1787786559.167857:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786559.167988:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667966336 00000100:00100000:3.0:1787786559.167998:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667966336 00000100:00100000:3.0:1787786559.168059:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 28 00000100:00100000:3.0:1787786559.168069:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b434f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+11:14462:x1874629667966336:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:3.0:1787786559.168089:0:14393:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787786559.168109:0:14393:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6c00/0x450132973bff3633 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7526dc expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.168253:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7200/0x450132973bff363a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.168269:0:14393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff3610 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526ce expref: 11 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.168280:0:14393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7200/0x450132973bff363a lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.168321:0:14393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff3610 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526ce expref: 11 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.168336:0:14393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff3610 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526ce expref: 11 pid: 14393 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786559.168364:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b4d4780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14393:1874629686827136:192.168.204.34@tcp:104: 00000100:00100000:3.0:1787786559.168666:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52103a4600 going to sleep for 11 seconds 00000100:00100000:0.0:1787786559.181390:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786559.181504:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b4d4780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14393:1874629686827136:192.168.204.34@tcp:104: 00010000:00010000:3.0:1787786559.181536:0:14393:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7200/0x450132973bff363a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786559.181666:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667966464 00000100:00100000:1.0:1787786559.181674:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667966464 00010000:00010000:1.0:1787786559.181713:0:14378:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff3610 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526ce expref: 12 pid: 14393 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786559.181771:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00100000:1.0:1787786559.181780:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4370c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+12:2365:x1874629667966464:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787786559.181837:0:14378:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786559.181845:0:14378:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff3610 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526ce expref: 12 pid: 14393 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.181857:0:14378:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff3610 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526ce expref: 12 pid: 14393 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.181881:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6200/0x450132973bff3610 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526ce expref: 12 pid: 14393 timeout: 585 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.181895:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8b5212779500) 00010000:00010000:1.0:1787786559.181900:0:14378:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7200/0x450132973bff363a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.181909:0:14378:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7200/0x450132973bff363a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.181916:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7200/0x450132973bff363a lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.181946:0:14378:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786559.182001:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4370c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+11:2365:x1874629667966464:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 222us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786559.182009:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 10 00010000:00010000:3.0:1787786559.182217:0:14393:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7200/0x450132973bff363a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.182224:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7200/0x450132973bff363a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.182246:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff3641 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.182257:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff3641 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.182265:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff3641 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.182968:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff3648 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.182977:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff3648 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.182985:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff3648 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787786559.183005:0:14393:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787786559.183032:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7200/0x450132973bff363a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.183040:0:14393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7200/0x450132973bff363a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.183047:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7200/0x450132973bff363a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.183053:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7200 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786559.183058:0:14393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7200/0x450132973bff363a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.183066:0:14393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7200/0x450132973bff363a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.183075:0:14393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8b5212779500) 00010000:00010000:3.0:1787786559.183078:0:14393:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787786559.183082:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7200/0x450132973bff363a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.183088:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7200/0x450132973bff363a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787786559.183099:0:14393:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eb4a7e1b reply state 00000000c5585415 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff3641 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786559.183106:0:14393:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787786559.183141:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb6c00/0x450132973bff3633 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526dc expref: 14 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.183169:0:14393:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff3648 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526dc expref: 13 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.183177:0:14393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b5212779300) 00010000:00010000:3.0:1787786559.183180:0:14393:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1787786559.183183:0:14393:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523bcb7c00, rc 0) 00000100:00100000:3.0:1787786559.183236:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b434f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+14:14462:x1874629667966336:12345-192.168.204.34@tcp:101:bash.0 Request processed in 15169us (15389us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1787786559.183245:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 28 00010000:00010000:1.0:1787786559.186098:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff3641 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.186144:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff3641 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.186152:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff3641 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.186299:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7e00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786559.186305:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff3641 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.186314:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff3641 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.186332:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8b5212779400) 00010000:00010000:1.0:1787786559.186335:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787786559.186339:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff3641 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.186346:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7e00/0x450132973bff3641 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786559.199300:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786559.199777:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667966592 00000100:00100000:1.0:1787786559.199820:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667966592 00000100:00100000:1.0:1787786559.199884:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 29 00000100:00100000:1.0:1787786559.199894:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523333b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+13:14462:x1874629667966592:12345-192.168.204.34@tcp:101:bash.0 00010000:00010000:1.0:1787786559.199917:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786559.199938:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff3656 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7526e3 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.200039:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff365d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.200054:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff365d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.200066:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff365d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787786559.200105:0:14427:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787786559.200109:0:14427:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787786559.200140:0:14427:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff365d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.200153:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff365d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.200177:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff3656 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526e3 expref: 15 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.200196:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff365d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526e3 expref: 14 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.200205:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b5212779300) 00010000:00010000:1.0:1787786559.200208:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787786559.200212:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523b4d8200, rc 0) 00000100:00100000:1.0:1787786559.200266:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523333b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+14:14462:x1874629667966592:12345-192.168.204.34@tcp:101:bash.0 Request processed in 374us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786559.200274:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 29 00000100:00100000:0.0:1787786559.206006:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786559.206096:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667966848 00000100:00100000:1.0:1787786559.206105:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667966848 00000100:00100000:1.0:1787786559.206171:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 5 00000100:00100000:1.0:1787786559.206181:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101371e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+14:14462:x1874629667966848:12345-192.168.204.34@tcp:35:bash.0 00000100:00100000:1.0:1787786559.206577:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101371e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+15:14462:x1874629667966848:12345-192.168.204.34@tcp:35:bash.0 Request processed in 397us (581us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1787786559.206585:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 5 00000100:00100000:0.0:1787786559.295215:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786559.295339:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667967104 00000100:00100000:2.0:1787786559.295350:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667967104 00000100:00100000:2.0:1787786559.295414:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 30 00000100:00100000:2.0:1787786559.295425:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101373840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+15:14472:x1874629667967104:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:2.0:1787786559.295451:0:14394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786559.295472:0:14394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff3664 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7526ea expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786559.295608:0:14394:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787786559.295755:0:14394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff3664 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526ea expref: 17 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.295770:0:14394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8b5222ae8300) 00010000:00010000:2.0:1787786559.295773:0:14394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787786559.295778:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff3664 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526ea expref: 17 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.295829:0:14394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523d7a8400, rc 0) 00000100:00100000:2.0:1787786559.295882:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101373840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+16:14472:x1874629667967104:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 459us (677us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1787786559.295890:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 30 00000100:00100000:0.0:1787786559.300095:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786559.300206:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667967360 00000100:00100000:1.0:1787786559.300216:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667967360 00000100:00100000:1.0:1787786559.300275:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 6 00000100:00100000:1.0:1787786559.300285:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b51013721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+16:14472:x1874629667967360:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:1.0:1787786559.300556:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b51013721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+17:14472:x1874629667967360:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 271us (470us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787786559.300564:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 6 00000100:00100000:0.0:1787786559.337123:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786559.337233:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667967616 00000100:00100000:1.0:1787786559.337243:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667967616 00000100:00100000:1.0:1787786559.337303:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 31 00000100:00100000:1.0:1787786559.337313:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b51013730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+17:14475:x1874629667967616:12345-192.168.204.34@tcp:101:lfs.0 00010000:00010000:1.0:1787786559.337336:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786559.337358:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff3672 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7526f1 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.337460:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff3679 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.337474:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff3679 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.337504:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff3679 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787786559.337519:0:14427:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787786559.337659:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff3672 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526f1 expref: 20 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.337678:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff3679 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526f1 expref: 19 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.337687:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b5212779300) 00010000:00010000:1.0:1787786559.337690:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787786559.337693:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523b4d9c00, rc 0) 00000100:00100000:1.0:1787786559.337757:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b51013730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+19:14475:x1874629667967616:12345-192.168.204.34@tcp:101:lfs.0 Request processed in 445us (644us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1787786559.337765:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 31 00000100:00100000:0.0:1787786559.341403:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786559.341455:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786559.341475:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667967744 00000100:00100000:2.0:1787786559.341490:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667967744 00000100:00100000:1.0:1787786559.341532:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667967872 00000100:00100000:1.0:1787786559.341537:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667967872 00000100:00100000:1.0:1787786559.341593:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 0 00000100:00100000:1.0:1787786559.341603:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221a9e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+20:2364:x1874629667967872:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787786559.341620:0:14379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786559.341659:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff3679 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526f1 expref: 20 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.341677:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b5212779300) 00010000:00010000:1.0:1787786559.341682:0:14379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786559.341757:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221a9e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+19:2364:x1874629667967872:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 156us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786559.341766:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 0 00000100:00100000:2.0:1787786559.341978:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 32 00000100:00100000:2.0:1787786559.341988:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5101371a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+18:14475:x1874629667967744:12345-192.168.204.34@tcp:54:lfs.0 00010000:00010000:2.0:1787786559.342048:0:14394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff3687 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.342063:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff3687 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.342167:0:14394:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff3687 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.342192:0:14394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff3687 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.342204:0:14394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff3687 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.342211:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff3687 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.342216:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523d7a8400 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786559.342220:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff3687 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.342227:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff3687 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.342235:0:14394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b5212779300) 00010000:00010000:2.0:1787786559.342238:0:14394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787786559.342241:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff3687 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.342247:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff3687 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14394 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786559.342292:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5101371a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+18:14475:x1874629667967744:12345-192.168.204.34@tcp:54:lfs.0 Request processed in 306us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786559.342298:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 32 00000100:00100000:0.0:1787786559.344910:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786559.345194:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667968128 00000100:00100000:1.0:1787786559.345202:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667968128 00000100:00100000:1.0:1787786559.345254:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:1.0:1787786559.345264:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221a9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+18:14475:x1874629667968128:12345-192.168.204.34@tcp:35:lfs.0 00000100:00100000:1.0:1787786559.346317:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221a9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+19:14475:x1874629667968128:12345-192.168.204.34@tcp:35:lfs.0 Request processed in 1047us (1409us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787786559.346328:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 7 00000040:00080000:1.0:1787786559.370975:0:14428:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787786559.643247:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786559.643563:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667968384 00000100:00100000:1.0:1787786559.643574:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667968384 00000100:00100000:1.0:1787786559.643647:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 33 00000100:00100000:1.0:1787786559.643657:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221a9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+19:14506:x1874629667968384:12345-192.168.204.34@tcp:101:cat.0 00010000:00010000:1.0:1787786559.643681:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786559.643701:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff368e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7526f8 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.643823:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff3695 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.643839:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff3695 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.643853:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff3695 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787786559.643864:0:14427:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787786559.644028:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff368e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526f8 expref: 22 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.644045:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff3695 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526f8 expref: 21 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.644053:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b5212779300) 00010000:00010000:1.0:1787786559.644055:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787786559.644058:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523b4d9a00, rc 0) 00000100:00100000:1.0:1787786559.644119:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221a9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+21:14506:x1874629667968384:12345-192.168.204.34@tcp:101:cat.0 Request processed in 464us (882us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1787786559.644126:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 33 00000100:00100000:0.0:1787786559.650851:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786559.650884:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786559.651019:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667968640 00000100:00100000:2.0:1787786559.651030:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667968640 00000100:00100000:2.0:1787786559.651081:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00100000:2.0:1787786559.651091:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221a9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+21:14506:x1874629667968640:12345-192.168.204.34@tcp:35:cat.0 00000100:00100000:2.0:1787786559.651414:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221a9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+22:14506:x1874629667968640:12345-192.168.204.34@tcp:35:cat.0 Request processed in 324us (573us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1787786559.651428:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 8 00000100:00100000:3.0:1787786559.652582:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667968768 00000100:00100000:3.0:1787786559.652592:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667968768 00000100:00100000:3.0:1787786559.652692:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 1 00000100:00100000:3.0:1787786559.652702:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7d7927fc-831f-42ff-8d88-89c0cf102351+22:2365:x1874629667968768:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787786559.652717:0:14380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786559.652753:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9a00/0x450132973bff3695 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526f8 expref: 22 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.652772:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b5212779300) 00010000:00010000:3.0:1787786559.652776:0:14380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787786559.652840:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221a9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7d7927fc-831f-42ff-8d88-89c0cf102351+21:2365:x1874629667968768:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 139us (1955us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786559.652848:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 1 00000100:00100000:1.0:1787786559.743654:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786559.743748:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667969024 00000100:00100000:3.0:1787786559.743758:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667969024 00000100:00100000:3.0:1787786559.743856:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 34 00000100:00100000:0.0:1787786559.743944:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+21:14512:x1874629667969024:12345-192.168.204.34@tcp:101:dd.0 00010000:00010000:0.0:1787786559.743971:0:14393:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786559.743992:0:14393:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff36a3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd7526ff expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786559.744091:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff36aa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786559.744105:0:14393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff3648 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526dc expref: 22 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786559.744114:0:14393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff365d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526e3 expref: 22 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786559.744122:0:14393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff36aa lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786559.744156:0:14393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff365d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526e3 expref: 22 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786559.744170:0:14393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff365d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526e3 expref: 22 pid: 14427 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786559.744183:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14393:1874629686827264:192.168.204.34@tcp:104: 00010000:00010000:0.0:1787786559.744284:0:14393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff3648 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526dc expref: 22 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786559.744293:0:14393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff3648 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526dc expref: 22 pid: 14393 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786559.744308:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221a9da40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14393:1874629686827392:192.168.204.34@tcp:104: 00000100:00100000:0.0:1787786559.744335:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52328bdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787786559.755734:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14393:1874629686827264:192.168.204.34@tcp:104: 00000100:00100000:2.0:1787786559.755750:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221a9da40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14393:1874629686827392:192.168.204.34@tcp:104: 00010000:00010000:2.0:1787786559.755778:0:14393:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff36aa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786559.758963:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786559.759196:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667969152 00000100:00100000:0.0:1787786559.759208:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667969152 00010000:00010000:0.0:1787786559.759251:0:14378:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff365d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526e3 expref: 23 pid: 14427 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786559.759295:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 11 00000100:00100000:0.0:1787786559.759306:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237b8e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+23:2364:x1874629667969152:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787786559.759324:0:14378:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787786559.759331:0:14378:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff365d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526e3 expref: 23 pid: 14427 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786559.759345:0:14378:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff365d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526e3 expref: 23 pid: 14427 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786559.759369:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff365d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526e3 expref: 23 pid: 14427 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786559.759385:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b5212779300) 00010000:00010000:0.0:1787786559.759391:0:14378:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff36aa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786559.759399:0:14378:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff36aa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786559.759423:0:14378:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787786559.759491:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237b8e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+22:2364:x1874629667969152:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 185us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786559.759499:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 11 00000100:00100000:0.0:1787786559.763586:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786559.763689:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667969280 00000100:00100000:3.0:1787786559.763699:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667969280 00010000:00010000:3.0:1787786559.763741:0:14380:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff3648 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526dc expref: 22 pid: 14393 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786559.763779:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00100000:3.0:1787786559.763825:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221a9e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7d7927fc-831f-42ff-8d88-89c0cf102351+22:2365:x1874629667969280:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787786559.763840:0:14380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787786559.763847:0:14380:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff3648 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526dc expref: 22 pid: 14393 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.763861:0:14380:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff3648 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526dc expref: 22 pid: 14393 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.763885:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff3648 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526dc expref: 22 pid: 14393 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.763902:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b5212779300) 00010000:00010000:3.0:1787786559.763907:0:14380:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff36aa lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.763916:0:14380:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff36aa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.763923:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff36aa lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786559.763950:0:14380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787786559.764000:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221a9e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7d7927fc-831f-42ff-8d88-89c0cf102351+21:2365:x1874629667969280:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 212us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786559.764022:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 12 00010000:00010000:2.0:1787786559.764426:0:14393:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff36aa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.764436:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff36aa lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786559.764457:0:14393:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787786559.764673:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff36a3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526ff expref: 22 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.764689:0:14393:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c200/0x450132973bff36aa lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd7526ff expref: 21 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.764696:0:14393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b5212779300) 00010000:00010000:2.0:1787786559.764699:0:14393:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787786559.764701:0:14393:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912c200, rc 0) 00000100:00100000:2.0:1787786559.764744:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+21:14512:x1874629667969024:12345-192.168.204.34@tcp:101:dd.0 Request processed in 20865us (21118us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1787786559.764752:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 34 00000100:00100000:0.0:1787786559.771682:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786559.771779:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667969536 00000100:00100000:1.0:1787786559.771824:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667969536 00000100:00100000:1.0:1787786559.771880:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 35 00000100:00100000:1.0:1787786559.771891:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+21:14512:x1874629667969536:12345-192.168.204.34@tcp:36:dd.0 00010000:00010000:1.0:1787786559.772169:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff36b8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.772188:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff36b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.772200:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff36b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787786559.772253:0:14427:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1787786559.772278:0:14427:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df12ef2f reply state 000000006a0f59fb transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff36b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786559.772301:0:14427:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787786559.772389:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221a9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+24:14512:x1874629667969536:12345-192.168.204.34@tcp:36:dd.0 Request processed in 499us (716us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1787786559.772397:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 35 00000020:00080000:1.0:1787786559.772402:0:14427:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787786559.775055:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff36b8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786559.775075:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff36b8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786559.775084:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff36b8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786559.775089:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8e00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786559.775094:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff36b8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786559.775102:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff36b8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786559.775119:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b5212779300) 00010000:00010000:0.0:1787786559.775122:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786559.775127:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff36b8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786559.775132:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8e00/0x450132973bff36b8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786559.776149:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786559.776212:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667969664 00000100:00100000:2.0:1787786559.776224:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667969664 00000100:00100000:2.0:1787786559.776292:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 36 00000100:00100000:2.0:1787786559.776302:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221a9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+23:14512:x1874629667969664:12345-192.168.204.34@tcp:101:dd.0 00010000:00010000:2.0:1787786559.776325:0:14394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786559.776344:0:14394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8c00/0x450132973bff36bf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752706 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.776405:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8c00/0x450132973bff36bf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752706 expref: 24 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.776419:0:14394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8c00/0x450132973bff36bf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752706 expref: 24 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.776439:0:14394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b5212779300) 00010000:00010000:2.0:1787786559.776443:0:14394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787786559.776446:0:14394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523d7a8c00, rc 0) 00000100:00100000:2.0:1787786559.776510:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221a9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+24:14512:x1874629667969664:12345-192.168.204.34@tcp:101:dd.0 Request processed in 210us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786559.776517:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 36 00000100:00100000:3.0:1787786559.818050:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786559.819850:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667969920 00000100:00100000:1.0:1787786559.819867:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667969920 00000100:00100000:1.0:1787786559.819962:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 2 00000100:00100000:1.0:1787786559.819974:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+24:14512:x1874629667969920:12345-192.168.204.34@tcp:103:dd.0 00010000:00010000:1.0:1787786559.819992:0:14379:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786559.820023:0:14379:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8c00/0x450132973bff36bf lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752706 expref: 24 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786559.820048:0:14379:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b5212779300) 00010000:00010000:1.0:1787786559.820053:0:14379:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786559.820132:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+23:14512:x1874629667969920:12345-192.168.204.34@tcp:103:dd.0 Request processed in 161us (2092us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786559.820140:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 2 00000100:00100000:1.0:1787786559.828511:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786559.828638:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667970048 00000100:00100000:2.0:1787786559.828650:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667970048 00000100:00100000:2.0:1787786559.828721:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 37 00000100:00100000:2.0:1787786559.828734:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+23:14512:x1874629667970048:12345-192.168.204.34@tcp:58:dd.0 00010000:00010000:2.0:1787786559.828885:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9c00/0x450132973bff36c6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.828904:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9c00/0x450132973bff36c6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.828934:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9c00/0x450132973bff36c6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787786559.829821:0:14427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787786559.829980:0:14427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1787786559.830048:0:14427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1787786559.830189:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+23:14512:x1874629667970048:12345-192.168.204.34@tcp:58:dd.0 Request processed in 1453us (1687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786559.830202:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 37 00000100:00100000:0.0:1787786559.833363:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786559.833680:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667970176 00000100:00100000:2.0:1787786559.833695:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667970176 00000100:00100000:2.0:1787786559.833761:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 38 00000100:00100000:2.0:1787786559.833773:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221a9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+23:14512:x1874629667970176:12345-192.168.204.34@tcp:101:dd.0 00010000:00010000:2.0:1787786559.833823:0:14394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786559.833846:0:14394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8c00/0x450132973bff36cd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75270d expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.834501:0:14394:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9c00/0x450132973bff36c6 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.834519:0:14394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8c00/0x450132973bff36cd lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75270d expref: 24 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.834540:0:14394:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9c00/0x450132973bff36c6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.834554:0:14394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8c00/0x450132973bff36cd lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75270d expref: 24 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.834589:0:14394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b5212779300) 00010000:00010000:2.0:1787786559.834592:0:14394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787786559.834597:0:14394:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8c00/0x450132973bff36cd lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75270d expref: 24 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786559.834604:0:14394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523d7a8c00, rc 0) 00000100:00100000:2.0:1787786559.834741:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221a9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+24:14512:x1874629667970176:12345-192.168.204.34@tcp:101:dd.0 Request processed in 969us (1387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786559.834750:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 38 00010000:00010000:0.0:1787786559.882496:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787786560.394054:0:14428:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787786560.394065:0:14428:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787786560.394118:0:14428:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1787786560.394126:0:14428:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1787786560.394249:0:14428:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523bf84000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14428:1874629686827520:192.168.204.34@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787786560.394365:0:14428:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5213697480 going to sleep for 11 seconds 00000100:00100000:0.0:1787786560.404156:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786560.404279:0:14428:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523bf84000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14428:1874629686827520:192.168.204.34@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787786560.404939:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667970304 00000100:00100000:3.0:1787786560.404949:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667970304 00000100:00100000:3.0:1787786560.405082:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 0 00000100:00100000:3.0:1787786560.405095:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221a9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7d7927fc-831f-42ff-8d88-89c0cf102351+24:14513:x1874629667970304:12345-192.168.204.34@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787786560.405194:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221a9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7d7927fc-831f-42ff-8d88-89c0cf102351+24:14513:x1874629667970304:12345-192.168.204.34@tcp:900:lhsmtool_posix.0 Request processed in 102us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786560.405202:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 0 00000100:00080000:2.0:1787786560.413233:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787786560.419436:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786560.420930:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667970432 00000100:00100000:2.0:1787786560.420946:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667970432 00000100:00100000:2.0:1787786560.421029:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 39 00000100:00100000:2.0:1787786560.421041:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221a9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+24:14513:x1874629667970432:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787786560.421083:0:14427:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787786560.421217:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221a9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+24:14513:x1874629667970432:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 Request processed in 178us (1791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786560.421225:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 39 00000100:00100000:1.0:1787786560.434579:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786560.434845:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667970560 00000100:00100000:0.0:1787786560.434855:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667970560 00000100:00100000:0.0:1787786560.434925:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 40 00000100:00100000:0.0:1787786560.434937:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+24:14513:x1874629667970560:12345-192.168.204.34@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1787786560.435023:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff36d4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.435043:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff36d4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.435057:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff36d4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.435134:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c800/0x450132973bff36db lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.435143:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c800/0x450132973bff36db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.435150:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c800/0x450132973bff36db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.435174:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ca00/0x450132973bff36e2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.435203:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ca00/0x450132973bff36e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.435210:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ca00/0x450132973bff36e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787786560.435254:0:14393:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787786560.435259:0:14393:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787786560.435275:0:14393:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ca00/0x450132973bff36e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.435285:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff36d4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.435292:0:14393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff36d4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.435300:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff36d4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.435307:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912c000 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786560.435311:0:14393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff36d4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.435319:0:14393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff36d4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.435330:0:14393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b5222ae8200) 00010000:00010000:0.0:1787786560.435333:0:14393:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786560.435338:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff36d4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.435355:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c000/0x450132973bff36d4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.435369:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c800/0x450132973bff36db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.435376:0:14393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c800/0x450132973bff36db lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.435383:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c800/0x450132973bff36db lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.435387:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912c800 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786560.435390:0:14393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c800/0x450132973bff36db lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.435396:0:14393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c800/0x450132973bff36db lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.435403:0:14393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8b5222ae8f00) 00010000:00010000:0.0:1787786560.435406:0:14393:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786560.435409:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c800/0x450132973bff36db lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.435414:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c800/0x450132973bff36db lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.435429:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ca00/0x450132973bff36e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.435436:0:14393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ca00/0x450132973bff36e2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.435448:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ca00/0x450132973bff36e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.435454:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912ca00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786560.435457:0:14393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ca00/0x450132973bff36e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.435464:0:14393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ca00/0x450132973bff36e2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.435472:0:14393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b5212779300) 00010000:00010000:0.0:1787786560.435475:0:14393:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786560.435477:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ca00/0x450132973bff36e2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.436646:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ca00/0x450132973bff36e2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786560.437055:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+24:14513:x1874629667970560:12345-192.168.204.34@tcp:34:lhsmtool_posix.0 Request processed in 2115us (2481us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786560.437066:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 40 00000100:00100000:0.0:1787786560.450657:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786560.450783:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667970816 00000100:00100000:2.0:1787786560.450807:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667970816 00000100:00100000:2.0:1787786560.450869:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 41 00000100:00100000:2.0:1787786560.450878:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221a9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+24:14513:x1874629667970816:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787786560.450898:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787786560.450918:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9200/0x450132973bff36e9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752714 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.451034:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff36f0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.451050:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff36f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.451061:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff36f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787786560.451072:0:14427:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787786560.451171:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff36f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.451179:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff36f0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.451186:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff36f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.451192:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523d7a8400 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786560.451196:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff36f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.451202:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff36f0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.451215:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b5212779300) 00010000:00010000:2.0:1787786560.451218:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787786560.451222:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff36f0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.451239:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8400/0x450132973bff36f0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.451303:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9200/0x450132973bff36e9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752714 expref: 26 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.451314:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8b5222ae8200) 00010000:00010000:2.0:1787786560.451316:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787786560.451320:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9200/0x450132973bff36e9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752714 expref: 26 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.451330:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523d7a9200, rc 0) 00000100:00100000:2.0:1787786560.451397:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221a9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+25:14513:x1874629667970816:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 520us (750us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1787786560.451404:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 41 00000100:00100000:3.0:1787786560.457503:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786560.457598:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667970944 00000100:00100000:2.0:1787786560.457609:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667970944 00000100:00100000:2.0:1787786560.457889:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 42 00000100:00100000:2.0:1787786560.457901:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+25:14513:x1874629667970944:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787786560.457942:0:14394:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787786560.458120:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+25:14513:x1874629667970944:12345-192.168.204.34@tcp:53:lhsmtool_posix.0 Request processed in 220us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786560.458129:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 42 00000100:00100000:1.0:1787786560.463092:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786560.464482:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667971200 00000100:00100000:0.0:1787786560.464500:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667971200 00000100:00100000:0.0:1787786560.464577:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 43 00000100:00100000:0.0:1787786560.464589:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+25:14513:x1874629667971200:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787786560.464613:0:14393:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786560.464654:0:14393:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ca00/0x450132973bff36fe lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd75271b expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787786560.465693:0:14393:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:0.0:1787786560.465701:0:14393:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1787786560.465746:0:14393:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1787786560.466060:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c800/0x450132973bff3705 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.466077:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c800/0x450132973bff3705 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.466087:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c800/0x450132973bff3705 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.466255:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912ca00/0x450132973bff36fe lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75271b expref: 28 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.466274:0:14393:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c800/0x450132973bff3705 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75271b expref: 27 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.466283:0:14393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8b5222ae8f00) 00010000:00010000:0.0:1787786560.466286:0:14393:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787786560.466289:0:14393:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912c800, rc 0) 00000100:00100000:0.0:1787786560.466529:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+27:14513:x1874629667971200:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 1940us (3446us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1787786560.466539:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 43 00000100:00100000:1.0:1787786560.474299:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786560.474465:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667971456 00000100:00100000:0.0:1787786560.474476:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667971456 00000100:00100000:0.0:1787786560.474560:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 44 00000100:00100000:0.0:1787786560.474571:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+27:14513:x1874629667971456:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787786560.474668:0:14393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787786560.474696:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c800/0x450132973bff3705 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75271b expref: 27 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.474726:0:14393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8b5222ae8f00) 00010000:00010000:0.0:1787786560.474736:0:14393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787786560.474760:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d800/0x450132973bff3713 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.474773:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d800/0x450132973bff3713 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.474782:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d800/0x450132973bff3713 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.474890:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912de00/0x450132973bff371a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc00fb989 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.474899:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912de00/0x450132973bff371a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc00fb989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.474906:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912de00/0x450132973bff371a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc00fb989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.474994:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d800/0x450132973bff3713 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.475001:0:14393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d800/0x450132973bff3713 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.475008:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d800/0x450132973bff3713 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.475020:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912d800 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786560.475024:0:14393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d800/0x450132973bff3713 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.475032:0:14393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d800/0x450132973bff3713 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.475040:0:14393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8b5212779500) 00010000:00010000:0.0:1787786560.475043:0:14393:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786560.475047:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d800/0x450132973bff3713 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.475053:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912d800/0x450132973bff3713 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.475061:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912de00/0x450132973bff371a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc00fb989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.475067:0:14393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912de00/0x450132973bff371a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc00fb989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.475074:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912de00/0x450132973bff371a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc00fb989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.475079:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912de00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:0.0:1787786560.475081:0:14393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912de00/0x450132973bff371a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc00fb989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.475087:0:14393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912de00/0x450132973bff371a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc00fb989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.475295:0:14393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xc00fb989 (ffff8b5222ae8e00) 00010000:00010000:0.0:1787786560.475299:0:14393:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787786560.475303:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912de00/0x450132973bff371a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc00fb989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.475310:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912de00/0x450132973bff371a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc00fb989 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786560.475405:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+26:14513:x1874629667971456:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 Request processed in 835us (1116us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787786560.475414:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 44 00000100:00100000:3.0:1787786560.477928:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786560.478992:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667971584 00000100:00100000:1.0:1787786560.479006:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667971584 00000100:00100000:0.0:1787786560.479197:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 45 00000100:00100000:0.0:1787786560.479211:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+26:14513:x1874629667971584:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787786560.479234:0:14393:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786560.479259:0:14393:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff3721 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752722 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.479299:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c400/0x450132973bff3728 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.479314:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c400/0x450132973bff3728 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.479325:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c400/0x450132973bff3728 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.479452:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff3721 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752722 expref: 28 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.479483:0:14393:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912c400/0x450132973bff3728 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752722 expref: 27 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.479491:0:14393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8b5222ae8b00) 00010000:00010000:0.0:1787786560.479495:0:14393:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787786560.479498:0:14393:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912c400, rc 0) 00000100:00100000:0.0:1787786560.479572:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+27:14513:x1874629667971584:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 365us (1653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786560.479578:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 45 00000100:00100000:3.0:1787786560.483232:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786560.483271:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667971840 00000100:00100000:3.0:1787786560.483281:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667971840 00000100:00100000:3.0:1787786560.483329:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 46 00000100:00100000:3.0:1787786560.483337:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+27:14513:x1874629667971840:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787786560.483543:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff372f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786560.483561:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff372f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786560.483572:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff372f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787786560.485205:0:14427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1787786560.485873:0:14427:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 486843997016ns, next at 487843991883ns, rc = 0 00000004:00010000:2.0:1787786560.486012:0:14427:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe569b08 reply state 000000003a136267 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff372f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786560.486037:0:14427:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787786560.486329:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4d4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+29:14513:x1874629667971840:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 Request processed in 2985us (3100us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1787786560.486339:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 46 00000100:00100000:1.0:1787786560.501661:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786560.502656:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667971968 00000100:00100000:0.0:1787786560.502669:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667971968 00000100:00100000:0.0:1787786560.502743:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 47 00000100:00100000:0.0:1787786560.502754:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523bf85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+29:14513:x1874629667971968:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787786560.502782:0:14394:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787786560.502834:0:14394:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff3736 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752729 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.502911:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff3736 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752729 expref: 30 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.502926:0:14394:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff3736 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752729 expref: 30 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.502947:0:14394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8b5222ae8b00) 00010000:00010000:0.0:1787786560.502951:0:14394:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787786560.502970:0:14394:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b520912dc00, rc 0) 00000100:00100000:0.0:1787786560.503041:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523bf85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+30:14513:x1874629667971968:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 289us (1391us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786560.503050:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 47 00010000:00010000:3.0:1787786560.503437:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff372f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786560.503457:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff372f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786560.503464:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff372f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786560.503470:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7c00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:3.0:1787786560.503475:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff372f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786560.503483:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff372f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786560.503495:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8b5222ae8b00) 00010000:00010000:3.0:1787786560.503498:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787786560.503501:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff372f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786560.503507:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff372f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786560.510441:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786560.511849:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667972096 00000100:00100000:2.0:1787786560.511872:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667972096 00000100:00080000:3.0:1787786560.511932:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787786560.511956:0:15080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00100000:2.0:1787786560.511969:0:15080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5237c0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d7927fc-831f-42ff-8d88-89c0cf102351+5:2365:x1874629667972096:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787786560.512327:0:15080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5237c0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d7927fc-831f-42ff-8d88-89c0cf102351+6:2365:x1874629667972096:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 Request processed in 361us (1896us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787786560.512336:0:15080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 12 00000100:00100000:1.0:1787786560.520604:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786560.521279:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667972352 00000100:00100000:2.0:1787786560.521290:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667972352 00000100:00100000:2.0:1787786560.521421:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 9 00000100:00100000:2.0:1787786560.521433:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+29:14513:x1874629667972352:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787786560.521723:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+30:14513:x1874629667972352:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 Request processed in 291us (1127us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1787786560.521732:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 9 00000100:00100000:3.0:1787786560.530139:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786560.530983:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667972608 00000100:00100000:2.0:1787786560.530996:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667972608 00000100:00100000:2.0:1787786560.531051:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 48 00000100:00100000:2.0:1787786560.531063:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5220164b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+30:14513:x1874629667972608:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787786560.531187:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5220164b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+30:14513:x1874629667972608:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 127us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786560.531206:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 48 00000100:00100000:3.0:1787786560.536514:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786560.537167:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667972736 00000100:00100000:1.0:1787786560.537195:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667972736 00000100:00100000:1.0:1787786560.537275:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 49 00000100:00100000:1.0:1787786560.537286:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+30:14513:x1874629667972736:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787786560.537309:0:14393:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786560.537333:0:14393:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9600/0x450132973bff373d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752730 expref: -99 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.537407:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff3744 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.537422:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff3744 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.537434:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff3744 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787786560.537473:0:14393:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787786560.537499:0:14393:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff3744 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.537526:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9600/0x450132973bff373d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752730 expref: 32 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.537564:0:14393:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff3744 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752730 expref: 31 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.537574:0:14393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8b5222ae8b00) 00010000:00010000:1.0:1787786560.537578:0:14393:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787786560.537581:0:14393:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523b4d9c00, rc 0) 00000100:00100000:1.0:1787786560.537664:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+31:14513:x1874629667972736:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 379us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786560.537672:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 49 00000100:00100000:3.0:1787786560.540422:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786560.540539:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667972864 00000100:00100000:1.0:1787786560.540549:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667972864 00000100:00100000:1.0:1787786560.540661:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 13 00000100:00100000:1.0:1787786560.540673:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+6:2364:x1874629667972864:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787786560.540693:0:15079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787786560.540718:0:15079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbbf28f4/0x450132973bff374b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4dbfcea1bd752737 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787786560.540747:0:15079:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8f7540, blocks: 0x1 00010000:00010000:1.0:1787786560.540766:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=486s v=(0 0) 00010000:00010000:1.0:1787786560.540771:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786560.540781:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbbf28f4/0x450132973bff374b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752737 expref: 7 pid: 15079 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.540833:0:15079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bbbf28f4/0x450132973bff374b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752737 expref: 7 pid: 15079 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.540869:0:15079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8b523b4d9a00, rc 0) 00000100:00100000:1.0:1787786560.540928:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+7:2364:x1874629667972864:12345-192.168.204.34@tcp:101:lhsmtool_posix.0 Request processed in 258us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786560.540934:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 13 00000100:00100000:2.0:1787786560.545000:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786560.545042:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667973120 00000100:00100000:2.0:1787786560.545053:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667973120 00000100:00100000:2.0:1787786560.545112:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 50 00000100:00100000:2.0:1787786560.545123:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5233339e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+31:14513:x1874629667973120:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787786560.545237:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5233339e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+31:14513:x1874629667973120:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 115us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786560.545245:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 50 00000100:00100000:0.0:1787786560.552634:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786560.552769:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667973248 00000100:00100000:2.0:1787786560.552780:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667973248 00000100:00100000:2.0:1787786560.552874:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 51 00000100:00100000:2.0:1787786560.552885:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221a9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+31:14513:x1874629667973248:12345-192.168.204.34@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1787786560.553029:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221a9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+31:14513:x1874629667973248:12345-192.168.204.34@tcp:44:lhsmtool_posix.0 Request processed in 145us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786560.553037:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 51 00000100:00100000:0.0:1787786560.556331:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786560.556610:0:15614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667973376 00000100:00100000:1.0:1787786560.556630:0:15614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667973376 00000100:00100000:1.0:1787786560.556695:0:15614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 14 00000100:00100000:1.0:1787786560.556707:0:15614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b437840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+7:2363:x1874629667973376:12345-192.168.204.34@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787786560.556912:0:15614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b437840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+7:2363:x1874629667973376:12345-192.168.204.34@tcp:16:lhsmtool_posix.0 Request processed in 205us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786560.556920:0:15614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 14 00000100:00100000:1.0:1787786560.559215:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786560.559255:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667973632 00000100:00100000:1.0:1787786560.559263:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667973632 00000100:00100000:1.0:1787786560.559329:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 52 00000100:00100000:1.0:1787786560.559339:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+31:14513:x1874629667973632:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787786560.559393:0:14427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786560.559421:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff3744 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752730 expref: 31 pid: 14393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.559440:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8b5222ae8b00) 00010000:00010000:1.0:1787786560.559445:0:14427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787786560.559476:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff3752 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.559528:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff3752 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.559539:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff3752 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787786560.560068:0:14427:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b85bc818 reply state 0000000062554b8d transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff3752 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786560.560079:0:14427:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787786560.560179:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+32:14513:x1874629667973632:12345-192.168.204.34@tcp:36:lhsmtool_posix.0 Request processed in 841us (973us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1787786560.560187:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 52 00000100:00100000:1.0:1787786560.564753:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00010000:00010000:1.0:1787786560.564861:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff3752 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.564874:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff3752 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.564882:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff3752 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.564888:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8600 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786560.564894:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff3752 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.564902:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff3752 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.564921:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8b5222ae8b00) 00010000:00010000:1.0:1787786560.564937:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787786560.564944:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff3752 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.564951:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8600/0x450132973bff3752 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786560.577052:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667973760 00000100:00100000:0.0:1787786560.577070:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667973760 00000100:00100000:1.0:1787786560.577514:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 15 00000100:00100000:1.0:1787786560.577524:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+7:2365:x1874629667973760:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787786560.577779:0:15078:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787786560.577784:0:15078:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787786559 00002000:00010000:1.0:1787786560.577787:0:15078:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787786559 00002000:00010000:1.0:1787786560.577981:0:15078:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787786560 -> 1787786559 00002000:00010000:1.0:1787786560.577983:0:15078:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787786560.578092:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+8:2365:x1874629667973760:12345-192.168.204.34@tcp:2:lhsmtool_posix.0 Request processed in 568us (13354us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1787786560.578112:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 15 00000100:00100000:1.0:1787786560.589723:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786560.590372:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667973888 00000100:00100000:3.0:1787786560.590386:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667973888 00000100:00100000:0.0:1787786560.590548:0:15080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 16 00000100:00100000:0.0:1787786560.590559:0:15080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d7927fc-831f-42ff-8d88-89c0cf102351+8:2364:x1874629667973888:12345-192.168.204.34@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787786560.590624:0:15080:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007fd41b57/0x450132973bff3759 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.590643:0:15080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787786560.590646:0:15080:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787786560.590652:0:15080:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007fd41b57/0x450132973bff3759 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.590667:0:15080:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007fd41b57/0x450132973bff3759 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.590700:0:15080:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007fd41b57/0x450132973bff3759 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.590708:0:15080:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007fd41b57/0x450132973bff3759 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.590730:0:15080:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007fd41b57/0x450132973bff3759 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.590738:0:15080:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912c800 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:0.0:1787786560.590742:0:15080:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007fd41b57/0x450132973bff3759 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.590751:0:15080:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007fd41b57/0x450132973bff3759 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.590767:0:15080:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007fd41b57/0x450132973bff3759 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.590775:0:15080:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007fd41b57/0x450132973bff3759 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15080 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786560.590994:0:15080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7d7927fc-831f-42ff-8d88-89c0cf102351+8:2364:x1874629667973888:12345-192.168.204.34@tcp:1:lhsmtool_posix.0 Request processed in 434us (1283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786560.591003:0:15080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 16 00000001:00080000:1.0:1787786560.594705:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:1.0:1787786560.594735:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:1.0:1787786560.594745:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1787786560.594764:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1787786560.595019:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5233338f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686827648:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1787786560.595096:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786560.595370:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686827648 00000100:00100000:0.0:1787786560.595379:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686827648 00000100:00100000:0.0:1787786560.595442:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787786560.595451:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523333a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686827648:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1787786560.595628:0:15079:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787786560.595633:0:15079:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787786559 -> 1787786559 00002000:00010000:0.0:1787786560.595650:0:15079:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 1787786559 -> 1787786559 00002000:00010000:0.0:1787786560.595652:0:15079:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787786559 -> 1787786559 00002000:00010000:0.0:1787786560.595654:0:15079:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787786560.595702:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523333a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1874629686827648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 251us (604us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1787786560.595710:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1787786560.595767:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1787786560.595827:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8b5233338f00/2, rc 0, transno 8589934596 00000100:00100000:2.0:1787786560.595834:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5233338f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686827648:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1787786560.604897:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786560.605047:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667974144 00000100:00100000:1.0:1787786560.605057:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667974144 00000100:00100000:1.0:1787786560.605118:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 53 00000100:00100000:1.0:1787786560.605127:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b437c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+14:14513:x1874629667974144:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787786560.605214:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff3760 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.605251:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff3760 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.605263:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff3760 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.605511:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff3767 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.605523:0:14393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff3736 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752729 expref: 15 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.605532:0:14393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff3767 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.605568:0:14393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff3736 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752729 expref: 15 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.605582:0:14393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff3736 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752729 expref: 15 pid: 14394 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786560.605597:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b1c780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14393:1874629686827776:192.168.204.34@tcp:104: 00000100:00100000:1.0:1787786560.605703:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b5213697480 going to sleep for 11 seconds 00000100:00100000:0.0:1787786560.616381:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b1c780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14393:1874629686827776:192.168.204.34@tcp:104: 00010000:00010000:0.0:1787786560.616415:0:14393:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff3767 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786560.625048:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:1.0:1787786560.625203:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667974272 00000100:00100000:1.0:1787786560.625213:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667974272 00010000:00010000:1.0:1787786560.625260:0:14378:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff3736 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752729 expref: 16 pid: 14394 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786560.625312:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 13 00000100:00100000:1.0:1787786560.625332:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b4370c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+16:2365:x1874629667974272:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787786560.625349:0:14378:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787786560.625357:0:14378:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff3736 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752729 expref: 16 pid: 14394 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.625371:0:14378:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff3736 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752729 expref: 16 pid: 14394 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.625395:0:14378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b520912dc00/0x450132973bff3736 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752729 expref: 16 pid: 14394 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.625411:0:14378:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8b5222ae8b00) 00010000:00010000:1.0:1787786560.625415:0:14378:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff3767 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.625424:0:14378:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff3767 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.625432:0:14378:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff3767 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.625462:0:14378:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786560.625521:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b4370c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+15:2365:x1874629667974272:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 189us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786560.625529:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 13 00010000:00010000:0.0:1787786560.629448:0:14393:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff3767 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.629468:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff3767 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787786560.629695:0:14393:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1787786560.629959:0:14393:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1787786560.630014:0:14393:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1787786560.630139:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b32580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14393:1874629686827904:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787786560.630273:0:14393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787786560.630387:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52328bde40 going to sleep for 11 seconds 00000100:00100000:2.0:1787786560.633637:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686827904 00000100:00100000:2.0:1787786560.633654:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686827904 00000100:00100000:2.0:1787786560.633766:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787786560.633778:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14393:x1874629686827904:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787786560.634377:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14393:x1874629686827904:12345-0@lo:1000:mdt00_000.0 Request processed in 598us (4099us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786560.634387:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787786560.638388:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b32580 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14393:1874629686827904:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787786560.640247:0:14393:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1787786560.640354:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b1de00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14393:1874629686828032:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787786560.640444:0:14393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786560.640505:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52090dda80 going to sleep for 11 seconds 00000100:00100000:3.0:1787786560.640678:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686828032 00000100:00100000:3.0:1787786560.640685:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686828032 00000100:00100000:3.0:1787786560.640758:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787786560.640767:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14393:x1874629686828032:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787786560.640979:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14393:x1874629686828032:12345-0@lo:1000:mdt00_000.0 Request processed in 213us (535us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1787786560.640987:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787786560.641535:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b1de00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14393:1874629686828032:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1787786560.641578:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff3767 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.641588:0:14393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff3767 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.641595:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff3767 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.641601:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8200 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786560.641606:0:14393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff3767 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.641623:0:14393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff3767 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.641641:0:14393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8b5222ae8b00) 00010000:00010000:1.0:1787786560.641644:0:14393:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787786560.641648:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff3767 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.641654:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d8200/0x450132973bff3767 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.641687:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9c00/0x450132973bff36c6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.641693:0:14393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9c00/0x450132973bff36c6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.641698:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9c00/0x450132973bff36c6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.641714:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523d7a9c00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:1.0:1787786560.641717:0:14393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9c00/0x450132973bff36c6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.641723:0:14393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9c00/0x450132973bff36c6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.641731:0:14393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b5212779300) 00010000:00010000:1.0:1787786560.641733:0:14393:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787786560.641741:0:14393:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8c00/0x450132973bff36cd lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75270d expref: 18 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.641752:0:14393:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8c00/0x450132973bff36cd lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75270d expref: 18 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.641761:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8c00/0x450132973bff36cd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75270d expref: 18 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.641850:0:14393:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a8c00/0x450132973bff36cd lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd75270d expref: 18 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786560.641864:0:14393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b1ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14393:1874629686828160:192.168.204.34@tcp:105: 00000100:00100000:1.0:1787786560.641999:0:14393:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52090ddb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787786560.648723:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786560.648860:0:14393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b1ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14393:1874629686828160:192.168.204.34@tcp:105: 00010000:00010000:2.0:1787786560.648892:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9c00/0x450132973bff36c6 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.648904:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9c00/0x450132973bff36c6 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.648938:0:14393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9000/0x450132973bff376e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.648952:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9000/0x450132973bff376e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.648965:0:14393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9000/0x450132973bff376e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.648975:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9000/0x450132973bff376e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.648981:0:14393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9000/0x450132973bff376e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.648987:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9000/0x450132973bff376e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.648992:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523d7a9000 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786560.648996:0:14393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9000/0x450132973bff376e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.649021:0:14393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9000/0x450132973bff376e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.649034:0:14393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b5212779300) 00010000:00010000:2.0:1787786560.649037:0:14393:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787786560.649040:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9000/0x450132973bff376e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.649045:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523d7a9000/0x450132973bff376e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.649054:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff3760 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.649061:0:14393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff3760 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.649066:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff3760 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.649071:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d9c00 already unused, calling callback (ffffffffc20024f0) 00010000:00010000:2.0:1787786560.649074:0:14393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff3760 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.649079:0:14393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff3760 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.649086:0:14393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8b5212779300) 00010000:00010000:2.0:1787786560.649088:0:14393:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787786560.649091:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff3760 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.649121:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523b4d9c00/0x450132973bff3760 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14393 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786560.649362:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b437c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+18:14513:x1874629667974144:12345-192.168.204.34@tcp:57:lhsmtool_posix.0 Request processed in 44233us (44473us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1787786560.649372:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 53 00000020:00080000:2.0:1787786560.649379:0:14393:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787786560.650049:0:14428:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1787786560.650055:0:14428:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787786560.650086:0:14428:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1787786560.650094:0:14428:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787786560.650267:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667974400 00000100:00100000:3.0:1787786560.650276:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667974400 00000100:00100000:3.0:1787786560.650322:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00100000:3.0:1787786560.650331:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5233321450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+18:14512:x1874629667974400:12345-192.168.204.34@tcp:49:dd.0 00000100:00100000:3.0:1787786560.650438:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5233321450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+18:14512:x1874629667974400:12345-192.168.204.34@tcp:49:dd.0 Request processed in 108us (1734us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786560.650446:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 10 00000100:00100000:0.0:1787786560.654089:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786560.654252:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667974656 00000100:00100000:3.0:1787786560.654262:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667974656 00000100:00100000:3.0:1787786560.654319:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 11 00000100:00100000:3.0:1787786560.654330:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b30f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+18:14513:x1874629667974656:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787786560.655511:0:14396:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787786560.655623:0:14396:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1787786560.655678:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff3775 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786560.655697:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff3775 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786560.655721:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff3775 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786560.655731:0:14396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff3775 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786560.655744:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff3775 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786560.655751:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff3775 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786560.655770:0:14396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787786560.659328:0:14382:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787786560.659343:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff3775 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.659354:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7c00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:0.0:1787786560.659359:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff3775 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.659369:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff3775 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.659387:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8b5222ae8b00) 00010000:00010000:0.0:1787786560.659390:0:14382:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787786560.659395:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff3775 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.659402:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8b523bcb7c00/0x450132973bff3775 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.659422:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786560.659424:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787786560.659425:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786560.659600:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b30f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+20:14513:x1874629667974656:12345-192.168.204.34@tcp:35:lhsmtool_posix.0 Request processed in 5266us (5517us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1787786560.659612:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 11 00000020:00080000:3.0:1787786560.659630:0:14396:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787786560.864664:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786560.864814:0:15083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667974784 00000100:00100000:3.0:1787786560.864824:0:15083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667974784 00000100:00100000:3.0:1787786560.864894:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 0 00000100:00100000:3.0:1787786560.864904:0:15083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b31e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+8:2363:x1874629667974784:12345-192.168.204.34@tcp:4:dd.0 00010000:00010000:3.0:1787786560.864937:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1ff83e5/0x450132973bff377c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786560.864958:0:15083:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bbbf28f4/0x450132973bff374b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752737 expref: 8 pid: 15079 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786560.864968:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787786560.864972:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787786560.864977:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1ff83e5/0x450132973bff377c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786560.865011:0:15083:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bbbf28f4/0x450132973bff374b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752737 expref: 8 pid: 15079 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786560.865040:0:15083:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bbbf28f4/0x450132973bff374b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752737 expref: 8 pid: 15079 timeout: 587 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786560.865056:0:15083:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360da40 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15083:1874629686828288:192.168.204.34@tcp:104: 00000100:00100000:3.0:1787786560.865220:0:15083:0:(client.c:2715:ptlrpc_set_wait()) set ffff8b52066120c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787786560.873335:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786560.873368:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786560.873396:0:15085:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787786560.873420:0:15085:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1787786560.873836:0:15084:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787786560.873854:0:15084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667974912 00000100:00100000:0.0:1787786560.873862:0:15084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667974912 00000100:00100000:0.0:1787786560.873910:0:15084:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787786560.873915:0:15084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667975040 00000100:00100000:0.0:1787786560.873918:0:15084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667975040 00000100:00100000:3.0:1787786560.878437:0:16623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 1 00000100:00100000:3.0:1787786560.878466:0:16623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523333ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+10:2362:x1874629667974912:12345-192.168.204.34@tcp:4:dd.0 00010000:00010000:3.0:1787786560.878535:0:16623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000419240ff/0x450132973bff3783 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786560.878557:0:16623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787786560.878563:0:16623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787786560.878568:0:16623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000419240ff/0x450132973bff3783 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786560.878579:0:16623:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000419240ff/0x450132973bff3783 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786560.880877:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786560.880913:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786560.880970:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786560.880985:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786560.881002:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786560.881031:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786560.881055:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667975680 00000100:00100000:0.0:1787786560.881063:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667975680 00010000:00010000:0.0:1787786560.881103:0:14380:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bbbf28f4/0x450132973bff374b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752737 expref: 11 pid: 15079 timeout: 587 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786560.881124:0:15085:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1787786560.881135:0:15085:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:0.0:1787786560.881147:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 14 00000100:00100000:0.0:1787786560.881171:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b31680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7d7927fc-831f-42ff-8d88-89c0cf102351+11:2364:x1874629667975680:12345-192.168.204.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787786560.881188:0:14380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787786560.881211:0:14380:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bbbf28f4/0x450132973bff374b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752737 expref: 11 pid: 15079 timeout: 587 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.881227:0:14380:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bbbf28f4/0x450132973bff374b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752737 expref: 11 pid: 15079 timeout: 587 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.881259:0:14380:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787786560.881264:0:14380:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787786560.881269:0:14380:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1ff83e5/0x450132973bff377c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.881279:0:14380:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1ff83e5/0x450132973bff377c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.881302:0:14380:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787786560.881305:0:14380:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787786560.881310:0:14380:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000419240ff/0x450132973bff3783 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.881317:0:14380:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000419240ff/0x450132973bff3783 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786560.881338:0:14380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787786560.881384:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667975168 00000100:00100000:1.0:1787786560.881389:0:15085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667975168 00000100:00100000:0.0:1787786560.881395:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b31680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7d7927fc-831f-42ff-8d88-89c0cf102351+12:2364:x1874629667975680:12345-192.168.204.34@tcp:103:ldlm_bl.0 Request processed in 235us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786560.881405:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 14 00000100:00100000:1.0:1787786560.881426:0:15085:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1787786560.881440:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667975296 00000100:00100000:1.0:1787786560.881443:0:15085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667975296 00000100:00100000:1.0:1787786560.881461:0:15085:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1787786560.881468:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667975424 00000100:00100000:1.0:1787786560.881470:0:15085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667975424 00000100:00100000:1.0:1787786560.881483:0:15085:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1787786560.881487:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667975552 00000100:00100000:1.0:1787786560.881490:0:15085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667975552 00000100:00100000:1.0:1787786560.881501:0:15085:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1787786560.881505:0:15085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667975808 00000100:00100000:1.0:1787786560.881507:0:15085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667975808 00010000:00010000:3.0:1787786560.881544:0:16623:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000419240ff/0x450132973bff3783 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786560.881555:0:16623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000419240ff/0x450132973bff3783 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786560.882862:0:16624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 2 00000100:00100000:1.0:1787786560.882880:0:16624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52333392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7d7927fc-831f-42ff-8d88-89c0cf102351+16:2362:x1874629667975040:12345-192.168.204.34@tcp:4:dd.0 00010000:00010000:1.0:1787786560.882918:0:16624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7c0f557/0x450132973bff378a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.882920:0:15083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbbf28f4/0x450132973bff374b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.34@tcp remote: 0x4dbfcea1bd752737 expref: 16 pid: 15079 timeout: 587 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.882948:0:16624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00000100:00100000:2.0:1787786560.882950:0:15083:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360da40 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15083:1874629686828288:192.168.204.34@tcp:104: 00010000:00010000:1.0:1787786560.882955:0:16624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786560.883156:0:16624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7c0f557/0x450132973bff378a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786560.883172:0:16624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7c0f557/0x450132973bff378a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.885299:0:15083:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e1ff83e5/0x450132973bff377c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.885320:0:15083:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e1ff83e5/0x450132973bff377c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.885327:0:15083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1ff83e5/0x450132973bff377c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787786560.915598:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787786561.010737:0:16623:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:3.0:1787786561.010749:0:16623:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1787786559 -> 1787786560 00002000:00010000:3.0:1787786561.010752:0:16623:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1787786559 -> 1787786560 00002000:00010000:3.0:1787786561.010754:0:16623:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:3.0:1787786561.010769:0:16623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000419240ff/0x450132973bff3783 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786561.010783:0:16623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000419240ff/0x450132973bff3783 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786561.010816:0:16623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000419240ff/0x450132973bff3783 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786561.010824:0:16623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7200 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:3.0:1787786561.010830:0:16623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000419240ff/0x450132973bff3783 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786561.010839:0:16623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000419240ff/0x450132973bff3783 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786561.010860:0:16623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000419240ff/0x450132973bff3783 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786561.010868:0:16623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000419240ff/0x450132973bff3783 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786561.010978:0:16623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523333ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+22:2362:x1874629667974912:12345-192.168.204.34@tcp:4:dd.0 Request processed in 132522us (137647us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1787786561.010989:0:16623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 1 00000100:00100000:3.0:1787786561.011023:0:16623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 3 00000100:00100000:3.0:1787786561.011035:0:16623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b33840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+21:2363:x1874629667975168:12345-192.168.204.34@tcp:4:dd.0 00010000:00010000:3.0:1787786561.011067:0:16623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005dfcc627/0x450132973bff3791 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786561.011079:0:16623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787786561.011083:0:16623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787786561.011089:0:16623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005dfcc627/0x450132973bff3791 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786561.011113:0:16623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005dfcc627/0x450132973bff3791 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787786561.027856:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:1.0:1787786561.027876:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:1.0:1787786561.027891:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:1.0:1787786561.027899:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:0.0:1787786561.058890:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:1.0:1787786561.059270:0:15083:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:1.0:1787786561.059275:0:15083:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 6151 00010000:00010000:1.0:1787786561.059301:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1ff83e5/0x450132973bff377c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786561.059314:0:15083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1ff83e5/0x450132973bff377c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786561.059323:0:15083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1ff83e5/0x450132973bff377c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786561.059330:0:15083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb6c00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:1.0:1787786561.059334:0:15083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1ff83e5/0x450132973bff377c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786561.059343:0:15083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1ff83e5/0x450132973bff377c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786561.059363:0:15083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1ff83e5/0x450132973bff377c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786561.059370:0:15083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1ff83e5/0x450132973bff377c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786561.059458:0:15083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b31e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+15:2363:x1874629667974784:12345-192.168.204.34@tcp:4:dd.0 Request processed in 194551us (194799us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1787786561.059472:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 0 00000100:00100000:1.0:1787786561.059506:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 4 00000100:00100000:1.0:1787786561.059518:0:15083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b32940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+14:2363:x1874629667975296:12345-192.168.204.34@tcp:4:dd.0 00010000:00010000:1.0:1787786561.059561:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd6a5695/0x450132973bff3798 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786561.059573:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786561.059577:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786561.059584:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd6a5695/0x450132973bff3798 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786561.059597:0:15083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd6a5695/0x450132973bff3798 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787786561.073939:0:16624:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1787786561.073963:0:16624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7c0f557/0x450132973bff378a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786561.073978:0:16624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7c0f557/0x450132973bff378a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786561.073987:0:16624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7c0f557/0x450132973bff378a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786561.073994:0:16624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8e00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:1.0:1787786561.073999:0:16624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7c0f557/0x450132973bff378a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786561.074008:0:16624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7c0f557/0x450132973bff378a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786561.074054:0:16624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7c0f557/0x450132973bff378a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786561.074063:0:16624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7c0f557/0x450132973bff378a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786561.074157:0:16624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52333392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7d7927fc-831f-42ff-8d88-89c0cf102351+14:2362:x1874629667975040:12345-192.168.204.34@tcp:4:dd.0 Request processed in 191278us (200782us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1787786561.074169:0:16624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 2 00000100:00100000:1.0:1787786561.074201:0:16624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 5 00000100:00100000:1.0:1787786561.074212:0:16624:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b312c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7d7927fc-831f-42ff-8d88-89c0cf102351+13:2362:x1874629667975424:12345-192.168.204.34@tcp:4:dd.0 00010000:00010000:1.0:1787786561.074266:0:16624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2a032dd/0x450132973bff379f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786561.074279:0:16624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786561.074284:0:16624:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786561.074290:0:16624:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2a032dd/0x450132973bff379f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786561.074302:0:16624:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2a032dd/0x450132973bff379f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787786561.104201:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:0.0:1787786561.104522:0:16623:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00010000:00010000:0.0:1787786561.104539:0:16623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005dfcc627/0x450132973bff3791 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786561.104553:0:16623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005dfcc627/0x450132973bff3791 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786561.104561:0:16623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005dfcc627/0x450132973bff3791 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786561.104569:0:16623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523bcb7a00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:0.0:1787786561.104574:0:16623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005dfcc627/0x450132973bff3791 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786561.104601:0:16623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005dfcc627/0x450132973bff3791 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786561.104637:0:16623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005dfcc627/0x450132973bff3791 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786561.104646:0:16623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005dfcc627/0x450132973bff3791 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786561.104764:0:16623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b33840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+15:2363:x1874629667975168:12345-192.168.204.34@tcp:4:dd.0 Request processed in 93729us (223892us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1787786561.104775:0:16623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 3 00000100:00100000:0.0:1787786561.104855:0:16623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 6 00000100:00100000:0.0:1787786561.104867:0:16623:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b31a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+14:2362:x1874629667975552:12345-192.168.204.34@tcp:4:dd.0 00010000:00010000:0.0:1787786561.104900:0:16623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cfe86a2/0x450132973bff37a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786561.104913:0:16623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787786561.104917:0:16623:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787786561.104924:0:16623:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001cfe86a2/0x450132973bff37a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786561.104937:0:16623:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001cfe86a2/0x450132973bff37a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787786561.151897:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:3.0:1787786561.152115:0:16624:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:3.0:1787786561.152120:0:16624:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:3.0:1787786561.152135:0:16624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2a032dd/0x450132973bff379f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786561.155767:0:16624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2a032dd/0x450132973bff379f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786561.155834:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd6a5695/0x450132973bff3798 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786561.155865:0:15083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd6a5695/0x450132973bff3798 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786561.155873:0:15083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd6a5695/0x450132973bff3798 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786561.155880:0:15083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d9000 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:1.0:1787786561.155885:0:15083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd6a5695/0x450132973bff3798 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786561.155896:0:15083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd6a5695/0x450132973bff3798 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786561.155916:0:15083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd6a5695/0x450132973bff3798 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786561.155924:0:15083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd6a5695/0x450132973bff3798 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787786561.156024:0:15083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b32940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+12:2363:x1874629667975296:12345-192.168.204.34@tcp:4:dd.0 Request processed in 96504us (275104us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1787786561.156034:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 4 00000100:00100000:1.0:1787786561.156070:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 7 00000100:00100000:1.0:1787786561.156081:0:15083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b32d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+11:2362:x1874629667975808:12345-192.168.204.34@tcp:4:dd.0 00010000:00010000:3.0:1787786561.156253:0:16624:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2a032dd/0x450132973bff379f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786561.156267:0:16624:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d9e00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:3.0:1787786561.156271:0:16624:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2a032dd/0x450132973bff379f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786561.156278:0:16624:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2a032dd/0x450132973bff379f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786561.156288:0:16624:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2a032dd/0x450132973bff379f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786561.156295:0:16624:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2a032dd/0x450132973bff379f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16624 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787786561.156381:0:16624:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b312c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7d7927fc-831f-42ff-8d88-89c0cf102351+10:2362:x1874629667975424:12345-192.168.204.34@tcp:4:dd.0 Request processed in 82172us (275410us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1787786561.156394:0:16624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 5 00010000:00010000:1.0:1787786561.156485:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7c0f557/0x450132973bff37ad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786561.156508:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786561.156512:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787786561.156518:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7c0f557/0x450132973bff37ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787786561.156530:0:15083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7c0f557/0x450132973bff37ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787786561.189076:0:16623:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:3.0:1787786561.189086:0:16623:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:3.0:1787786561.189102:0:16623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001cfe86a2/0x450132973bff37a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786561.189121:0:16623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001cfe86a2/0x450132973bff37a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786561.189131:0:16623:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001cfe86a2/0x450132973bff37a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786561.189138:0:16623:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b520912de00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:3.0:1787786561.189156:0:16623:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001cfe86a2/0x450132973bff37a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787786561.189217:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00010000:00010000:3.0:1787786561.189367:0:16623:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001cfe86a2/0x450132973bff37a6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786561.189389:0:16623:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001cfe86a2/0x450132973bff37a6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787786561.189397:0:16623:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cfe86a2/0x450132973bff37a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787786561.189493:0:16623:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b31a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7d7927fc-831f-42ff-8d88-89c0cf102351+9:2362:x1874629667975552:12345-192.168.204.34@tcp:4:dd.0 Request processed in 84625us (308501us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1787786561.189502:0:16623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 6 00002000:00010000:0.0:1787786561.226889:0:15083:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1787786561.226913:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7c0f557/0x450132973bff37ad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786561.226925:0:15083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7c0f557/0x450132973bff37ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786561.226933:0:15083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7c0f557/0x450132973bff37ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786561.226940:0:15083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8b523b4d8e00 already unused, calling callback (ffffffffc15bd420) 00010000:00010000:0.0:1787786561.226945:0:15083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7c0f557/0x450132973bff37ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786561.226953:0:15083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7c0f557/0x450132973bff37ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786561.226972:0:15083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7c0f557/0x450132973bff37ad lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787786561.226979:0:15083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7c0f557/0x450132973bff37ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787786561.227098:0:15083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b32d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7d7927fc-831f-42ff-8d88-89c0cf102351+7:2362:x1874629667975808:12345-192.168.204.34@tcp:4:dd.0 Request processed in 71005us (346051us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1787786561.227120:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 7 00000001:00080000:2.0:1787786561.227224:0:6723:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:0.0:1787786561.930370:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786562.059189:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787786562.059228:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523360de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686828416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787786562.059306:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786562.059384:0:15082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686828416 00000100:00100000:3.0:1787786562.059393:0:15082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686828416 00000100:00100000:3.0:1787786562.059471:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787786562.059481:0:15082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686828416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787786562.059524:0:15082:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787786562.059574:0:15082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874629686828416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786562.059582:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787786562.059618:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787786562.059682:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523360de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1874629686828416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787786562.060820:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b9512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686828800:0@lo:400:kworker.0 00000100:00100000:2.0:1787786562.060884:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787786562.060917:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787786562.060923:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b952d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686828928:0@lo:400:kworker.0 00000100:00100000:2.0:1787786562.060946:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786562.061122:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b9521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686828672:0@lo:400:kworker.0 00000100:00100000:1.0:1787786562.061159:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786562.061182:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1787786562.061188:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b950f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3312:1874629686828544:0@lo:400:kworker.0 00000100:00100000:1.0:1787786562.061229:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786562.061256:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b523b953840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874629686829056:0@lo:400:kworker.0 00000100:00100000:1.0:1787786562.061280:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787786562.061307:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686828800 00000100:00100000:1.0:1787786562.061315:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686828800 00000100:00100000:1.0:1787786562.061353:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686828928 00000100:00100000:1.0:1787786562.061356:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686828928 00000100:00100000:1.0:1787786562.061377:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686829056 00000100:00100000:1.0:1787786562.061379:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686829056 00000100:00100000:1.0:1787786562.061395:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787786562.061535:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b953c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686828800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786562.061600:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b953c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874629686828800:12345-0@lo:400:kworker.0 Request processed in 56us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786562.061607:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787786562.061645:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787786562.061651:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523b951680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686828928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786562.061680:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523b951680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874629686828928:12345-0@lo:400:kworker.0 Request processed in 30us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786562.061686:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787786562.061696:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787786562.061702:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874629686829056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787786562.061732:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874629686829056:12345-0@lo:400:kworker.0 Request processed in 30us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786562.061737:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787786562.061755:0:15614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686828672 00000100:00100000:1.0:1787786562.061758:0:15614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686828672 00000100:00100000:1.0:1787786562.061784:0:15614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787786562.061818:0:15614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686828672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787786562.062018:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b953840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1874629686829056:0@lo:400:kworker.0 00000100:00080000:3.0:1787786562.062761:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787786562.062769:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787786562.062993:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686828544 00000100:00100000:2.0:1787786562.062999:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686828544 00000100:00100000:2.0:1787786562.063050:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787786562.063058:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52329aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+19:3312:x1874629686828544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787786562.076209:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52329aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f0fadc2-0f1f-457d-abaa-699e28e40aa1+19:3312:x1874629686828544:12345-0@lo:400:kworker.0 Request processed in 13139us (14967us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786562.076240:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787786562.076345:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b950f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6f0fadc2-0f1f-457d-abaa-699e28e40aa1:3312:1874629686828544:0@lo:400:kworker.0 00000100:00100000:3.0:1787786562.079892:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b952d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1874629686828928:0@lo:400:kworker.0 00000100:00100000:3.0:1787786562.079916:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b9512c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874629686828800:0@lo:400:kworker.0 00000100:00100000:2.0:1787786562.083978:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1787786562.083991:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8b5233338f00, transno 8589934596 00000004:00080000:2.0:1787786562.084013:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1787786562.084041:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b523b9521c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686828672:0@lo:400:kworker.0 00000100:00100000:1.0:1787786562.085168:0:15614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686828672:12345-0@lo:400:kworker.0 Request processed in 22045us (22675us total) trans 0 rc 0/0 00000100:00100000:1.0:1787786562.085183:0:15614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000001:02000400:3.0:1787786562.921489:0:16662:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1787786562.961038:0:14381:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787786563.517616:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786563.517663:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786563.517696:0:14386:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667975936 00000100:00100000:3.0:1787786563.517703:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786563.517709:0:14386:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667975936 00000100:00100000:3.0:1787786563.517741:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786563.517766:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:2.0:1787786563.517773:0:14386:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 123 00000100:00100000:2.0:1787786563.517784:0:14386:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b52329aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:380b0949-bde9-4f98-9870-b4d676348301+13:2363:x1874629667975936:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:3.0:1787786563.517824:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:3.0:1787786563.517854:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.34@tcp (source: 12345-192.168.204.34@tcp) 00000100:00100000:0.0:1787786563.517874:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667976320 00000100:00100000:0.0:1787786563.517879:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667976320 00000100:00100000:3.0:1787786563.517880:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667976576 00000100:00100000:3.0:1787786563.517886:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667976576 00000100:00100000:2.0:1787786563.517905:0:14386:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b52329aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:380b0949-bde9-4f98-9870-b4d676348301+13:2363:x1874629667975936:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 121us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786563.517923:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667976192 00000100:00100000:2.0:1787786563.517930:0:14386:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 123 00000100:00100000:0.0:1787786563.517932:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667976704 00000100:00100000:3.0:1787786563.517935:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667976192 00000100:00100000:0.0:1787786563.517936:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667976704 00000100:00100000:0.0:1787786563.517967:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 15 00000100:00100000:0.0:1787786563.517974:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+5:2362:x1874629667976576:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1787786563.518003:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+5:2362:x1874629667976576:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 30us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786563.518009:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 15 00000100:00100000:0.0:1787786563.518022:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 16 00000100:00100000:0.0:1787786563.518028:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+5:2362:x1874629667976320:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1787786563.518051:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+5:2362:x1874629667976320:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 24us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786563.518057:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 16 00000100:00100000:0.0:1787786563.518069:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 17 00000100:00100000:2.0:1787786563.518070:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667976064 00000100:00100000:2.0:1787786563.518074:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667976064 00000100:00100000:0.0:1787786563.518075:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+5:2362:x1874629667976192:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1787786563.518101:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+5:2362:x1874629667976192:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 25us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786563.518107:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 17 00000100:00100000:2.0:1787786563.518116:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629667976448 00000100:00100000:0.0:1787786563.518117:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 18 00000100:00100000:2.0:1787786563.518118:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629667976448 00000100:00100000:0.0:1787786563.518123:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+5:2362:x1874629667976704:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:2.0:1787786563.518136:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 29 00000100:00100000:2.0:1787786563.518142:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+20:2362:x1874629667976064:12345-192.168.204.34@tcp:400:kworker.0 00000100:00100000:0.0:1787786563.518154:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+5:2362:x1874629667976704:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 32us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1787786563.518160:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 18 00000100:00100000:2.0:1787786563.518170:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7d7927fc-831f-42ff-8d88-89c0cf102351+20:2362:x1874629667976064:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 29us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786563.518176:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 29 00000100:00100000:2.0:1787786563.518187:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.34@tcp, seq: 30 00000100:00100000:2.0:1787786563.518193:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b523360c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+6:2362:x1874629667976448:12345-192.168.204.34@tcp:400:kworker.0 00000100:00080000:0.0:1787786563.518205:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787786563.518210:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787786563.518212:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787786563.518216:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b523360c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cfa1d334-bc04-48ef-a4cf-16cdb18f988d+6:2362:x1874629667976448:12345-192.168.204.34@tcp:400:kworker.0 Request processed in 23us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787786563.518222:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.34@tcp, seq: 30 00010000:00010000:3.0:1787786563.979612:0:14382:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787786564.117969:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8b5221b1ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686829184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787786564.118057:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787786564.118136:0:15082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874629686829184 00000100:00100000:3.0:1787786564.118145:0:15082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874629686829184 00000100:00100000:3.0:1787786564.118218:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787786564.118231:0:15082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8b5221b1c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686829184:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787786564.118238:0:14389:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1787786564.118272:0:15082:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1787786564.118337:0:15082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8b5221b1c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874629686829184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787786564.118345:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787786564.118416:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8b5221b1ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1874629686829184:0@lo:13:osp-pre-0-0.0 Debug log: 29237 lines, 29237 kept, 0 dropped, 0 bad.